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This "Frame of Reference Study" consists of the fifth 
section of the final report of the Multi-Disciplinary Graduate 
Program in Educational Research of the University of Pittsburgh, The 
term, "frames of reference," is used to mean the context of 
assumptions, procedures, rules, cognitive models, and conceptions of 
the nature of evidence that establishes the framework within which an 
investigator can proceed to detect problems for investigation and 
formulate strategies for their solution, , The study assumed as goals: 
(1) to devise methods of instruction for presenting alternate frames 
of reference and their understandiiig by participants; (2) to conduct 
a methodology for the study of frames of reference, to explore its 
feasibility, and to improve it by indepth studies of a number of 
expert participants. The instructional device developed was a 
semi-structured, expert-expert interview system with practitioners in 
the fields of psychology, sociology, psychiatry, and law, which 
facilitated a growth of communication skills assisting in the 
transfer of concepts and methodologies from one frame of reference to 
another and led to an understanding of the coherence of the scholarly 
approach. Included in the document are (1) an introduction detailing 
the development of the study, (2) a working paper on the study of 
frames of reference, (3) an example of staff papers on the work of a 
participating scholar, (4) a draft paper, "On Doing Empirical 
Sociology of Knowledge," and (5) conclusions and outlook for the 
study, (MB) ' ^ 
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THE FRAME OF REFERENCE STUDY 
A Component of the Multi--Disciplinary Graduate PiOgram in Educational Research 

In the following pages we present the report on the Frame of 
Reference Study, an investigation and educational pilot project conducted 
in the context of the Multi-Disciplinary Graduate Program in Educational 
Research. This project pursued both educational and basic social sci- 
entific objectives by addressing itself to the study of scholarly 
reference frames, as they are manifest in actual investigations. The 
Instructional device of the "expert-expert interview" in the context of a 
graduate seminar was developed; procedures for instruction in problem 
detection and solution were established. By focussing on the study of 
scholarly frames of reference and modes of inquiry, the project makes a 
contribution to the understanding of multi-disciplinary efforts, and 
basic processes in the production and communication of knowledge. 

The following report presents an overview of the project in the 
Introduction, followed by a collection of materials including the procedures 
and instruments used in the investigation, staff papers; prepared on the 
work of the participating scholars that was subject to systematic scrutiny, 
followed by papers on the theoretical and methodological issues of the 
investigation. 

Contents: 

1. Introduction: The Development of the Study 

2. The Study of Frames of Reference, a Working Paper 

3. An Example of Staff Papers on Work Completed by Participating 
Scholars: The Work of Arthur Melton j ■ 
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4. Draft "On Doing Empirical Sociology of Knowledge," Mitroff 
and Holzner 

5. Conclusions and Outlook, Holzner 

Introduction; The Development of the Frame of Reference Study 

In the context of the Multi-Disciplinary Graduate Program in 
Educational Research it soon became clear" that the multi-disciplinary 
educational setting provided intellectual challenges of a particular 
kind. Students and professors from a variety of disciplines joined to-* 
gether for discussion of substantive and methodological issues relating 
to research on education. The multi-disciplinarity of this context il-* 
lustrated dramatically botli the strength and weakness of disciplinary 
thinking. The coherent cognitive structure of a disciplinary orientation, 
or even more specifically of that prevailing in a sub-discipline or in 
a particular group of investigators, is a condition of specialized and 
detailed knowledge, systematically produced and coherently organized. 
However, the veiy strength of systematicity in such orientations also is 
a source of their limitation, producing professional "tunnel vision," and 
difficulties in communication. 

The Multi-Disciplinary Graduate Program in Educational Research had, 
from the start, recognized the importance of the problems of multi-dis-- 
ciplinarity and addressed itself to them at first from perspective 
grounded in the philosophy of science. However, it became quite apparent 
that the highly abstract perspectives on knowledge and its multiplicity of 
reference frames, which were to be gained from the philosophical base, 
were an insufficiently concrete tool both for instructional and organizational 
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purposes. Organizing experts with different outlooks into a coherent 
enterprise requires an understanding not only of the epistemological and 
methodological issues involved, but also of the sociological- issues 
arising from the fact that knowledge is produced in different, and not 
always necessarily convergent, frames of reference. Of particular im- 
portance in this context are the problems of scholarly communication. 
Several instances occurred in the work of the multi-disciplinary program 
in which substantive knowledge or methodological devices generated within 
one discipline found resistance in another, even though they would be 
highly appropriate tO' the problems under investigation. 

Multi-disciplinary efforts can work in a variety of ways, but for 
success they require as a minimum a coherent theme, a real problem, and 
an effective organi2a'tion. The Multi-Disciplinary Graduate Program in 
Education at Pittsburgh proceeded at several levels simultaneously. 
It did pursue the broad theme of research relevant to American education; 
it further concentrated on several substantive problem areas in which 
collective efforts would be useful to individual participants, so that 
knowledge from a variety of perspectives could be brought to bear on the 
same problem. It also, deliberately and self-consciously, turned its 
attention to the epistemic and social organiz.ational issues involved 
in multi-disciplinary research efforts. One major aspect of these enter- 
prises is the frame of reference study. 

This study has developed a methodology for the investigation of 
scholarly frames of reference. By this term is meant the context of 
often implicit assumptions, cognitive models, procedural rules, and con- 
ceptions of the nature of evidence which establishes the framework within 
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which an investigator can proceed to detect problems for investigation, 
and formulate strategies for their solution. Naturally, the objective of 
this study was not simply to show that there are differences in frames 
of reference • This, in fact, is well knoTcn* Lawyers, sociologists, and 
psychologists — just to name three examples — differ sharply in their 
conception of what constitutes acceptable evidence. The trial lawyer 
might be reluctant to accept sociological interview results as consti- 
tuting evidence since they have little similarity to the sworn dispositions 
or witness accounts in cross examination on which he is accustomed to 
build conclusive proof. The laboratory psychologist, for example, 
investigating learning phenomena, is likely to be distrustful of the 
quality of evidence produced by the participant observer of a group process, 
and vice versa. ■ It is important to know what the dimensions of difference 
in frames of reference might be, and in what manner their dynamics function. 
These matters are important to know both from the point of view of basic 
social scientific questions, and for the instructional objectives of any 
multi-disciplinary enterprise. Explicit procedures for the understanding 
of alternative frames of reference not only aid in professional communica- 
tion, but also can assist in devising more effective organizational arrange- 
ments for cooperation among experts of varying backgrounds. 

The frame of reference study therefore set itself several objectives. 
The instructional objective was to devise methods of advanced instruction 
suitable for the presentation of alternative frames of reference, and their 
effective understanding by participants. It relied in this regard on the 
method of the expert-expert interview before a seminar audience. Instruc- 
tional sessions of this type require considerable preparation. Experts 
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selected for participation were asked to identify a body of work they had 
completed which would become the subject of the interview. In addition, 
they were supplied with a staff paper to which ^ll participating experts 
responded. Members of the seminar had read these materials before the 
session; the interview proceeded on the basis of an interview schedule 
in a semi^structured format. 

The procedure has proven sufficient plausibility that certain meri.ts 
can be claimed for it. Through the interview procedure it is possible 
to clarify not only the substantive knowledge gained by an investigator 
but also his orientation to the problem formulation and methodology. 
Choices nade by the investigator in the course of his research can be 
revealed as selections from among alternatives, even though the investiga- 
tor himself may not have given the alternatives systematic consideration. 
The relationship between basic epistemic and methodological assumptions 
and actual empirical procedures can be demonstrated in a manner that 
allows students a comparison of several different approaches. The inter- 
view can demonstrate a model for interdisciplinary expert communications. 
In addition, of course, there are certain "dramaturgical'' advantages to the 
interview^ format which probably permit the conveyance of more concentrated 
information than could be absorbed in a one-person lecture of equal duration. 

The social scientific objective of this study was to construct a 
methodology for the study of frames of reference, to explore its feasibility 
and to improve it by in-depth studies of a small number of select expert 
participants. The procedure developed allows for the systematic exploration 
of a body of scholarly work through documentary study and through interviews 
linking the cognitive orientations of the investigator to institutional 
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settings and social networks in which he Is embedded, as well to 
theoretically or "paradigmatically*' defined issues of inves Ligation. In 
fact, one of the main concerns of the exploration dealt with the way 
in which problems of inquiry are selected and formulated, and how the 
problem formulation itself may bear on the choice of strategies for 
solution. 

The working group conducting the study was led by Burkart Holzner 
and Ian Mitroff , and included Evelyn Fisher, Charles T?ggatz, Charles 
Penoi, Leslie Salmon-Cox, Todd Simmonds, and ar times Geoffrey Guest. 
The group and the program of work crystallized from several antecedent 
concarns. A faculty seminar dealing with the question of the structure 
of frames of reference in social life, a group with a distinctly social 
psychological orientation, had been formed by Holzner and Mitroff during 
the year preceding this study* It was in this context that the objective 
was formulated to devise a systematic nethodology, which appeared as a 
necessary next step in the progressive clarification of this domain, 
Ian Mitroff had just completed a major investigation of the orientation 
systems and modes of inquiry of scientists studying the samples of moon 
rock brought back by the Appollo missions. Evel3m Fisher, In discussion 
with Paul Lazarsfeld, recognized the instructional potential of these in- 
vestigations and provided stimulus for the freme of reference program. 

Several steps were necessary in evolving the design of the project. 
The first phase of intensive work dealt with the clarification of the con- 
cept "frame of reference" and resulted in the clarification of the hypo- 
Chetical structure of reference frames. Clearly, these conceptions were not 
thought to be final but rather the starting point of the investigation. 
Several components of frames of reference were identified which were thought 
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to be capable — within limits — of independent variations. 

These concepts are presented in their early form in the "Working 

Paper on the Concept Frames of Reference" among the following materiali?. 

On the basis of these reflections a methodology was constructed, 
giving careful consideration to the kinds of information to be acquired by 
means of structured instruments, and documentary analysis. Considerable 
effort was spent in devising a group setting for the "expert-expert" 
Interviews which would fos^ter concentration on a particular level of 
analysis, which vrould reveal the working frame of reference of the scholar 
while avoiding a premature reductionist explanation of it — such as might 
occur when an expert participant might become tempted to "psychoanalyze" 
himself In an amateur fashion. The methodology deliberately emphasized 
a presentation of the kinds of considerations having a direct bearing on 
choices made during scholarly vjork. It also required the collection of 
information about biographical events and social structural contexts which 
can, of course, be interpreted from a variety of points of view. The 
nature of this methodology is described below both in the working paper 
"Studying Frames of Reference" and in the paper by Mitroff and Holzner 
"On Doing Empirical Sociology of Knowledge." 

Six scholars of distinction agreed to participate in this study; 
they generously made materials available, wrote memoranda about their own 
work and prepared for the interview sessions and each participated in two 
days of interviewing in Pittsburgh. The participating scholars were Robert 
Glaser, Thomas Fararo, T^lter Menninger, Seymour"~HaYtirrtIpset , Arthur" U7 
Melton, and Thomas Kerr. The group includes two psychologists (Glaser and 
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Melton), two sociologists (Fararo and Lipset), on psychiatrist (Hexminger) , 
and one lawyer (Kerr)* The interviews were taped and transcribed; they are 
being edited and analyzed in the case study format for publication. The 
selection of participating scholars has provided 3 very considerable range 
of orientations, both across disciplines and in the mode of investigative 
style. For the purpose of the pilot inquiry as well as for the construction 
of the instructional settings and materials, it x^as considered desirable 
to have large differences among the participants, while each of them also 
addressed themselves to problems in education. These orientations pro- 
vided for differentiation along the dimensions of applied versus basic 
science, deductive versus inductive inquiry, survey and historical methods 
versus laboratory investigations, as well as variations in the standards of 
proof considered adequate. 

The results of this study are highly suggestive for further work. 
They include a repllcable methodology and Instructional procedures that 
can be used by others. Results have been and will be presented at pro- 
fessional meetings as well as in published form: 
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PROCEDURES 

The selection of expert participants . 

In order to reach the objective of the program, the expert partici- 
pants invited must all be persons who have completed investigations 
resulting in new knowledge in social inquiry. The domain is limited to 
social investigations in order to simplify the task of comparability; it 
is not limited to social science as such. For example, it appeared 
important to include the area of legal investigative techniques. This 
field certainly falls under the heading of social inquiry but is hardly 
''social science." 

Three disciplines are included: psychology, sociology, and juris- 
prudence, with tha possible extension of the program into economics if 
resources permit. Within each discipline an attempt is made to have large 
differences between the approaches of the participants; qualitative, 
quantitative, primarily theoretical and primarily applied approaches are 
included. 

For example, in the pilot phase of the program in which the pro- 
cedures were tested and refined two expert participants collaborated: 
Robert Glaser, an empirical, quantitative psychologist devoted to applied 
research and development, £Lnd Thomas Fararo, a sociologist primarily 
concerned with the construction of abstracts-theoretical, pure sociology 
through mathematics. Since this study is both didactic and exploratory 
it is important to maximize significant differences; but it is not 
Important to insist on a systematic sampling scheme. All expert partici- 
pants are major scholars, presenting recognized alternatives for the con- 
duct of social inquiry. Given this broad scheme individual experts are 
selected on the basis of far- ranging consultations with informed persons. . 
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The role of the expert participants; the interviews * 

The expert participants are requested to prepare a brief memoran- 
dum indicating the domain of their work which they propose to make the 
substance of analysis in this study. This memorandum should include a 
bibliography and, where materials might not be readily accessible,- re- 
prints of all relevant papers. The staff of the frame of reference study 
and the members of the doctoral seminar will study this material and will 
prepare a summary paper. This paper is presented to the expert partici- 
pant for review and circulated among the faculty and students of the 
Pittsburgh group before his visit. This step makes it unnecessary for 
the expert to give a lecture presentation of his work. It \j±11 already 
be known in considerable detail. 

Two interview sessions then are conducted in Pittsburgh which 
will cover three major topics. Session I deals with the position of the 
expert in the network of other scholars and explores his intellectual 
biography with particular emphasis on the context of the substantive 
work under discussion. In preparation for this interview the expert 
participant receives a checklist which should be considered in analogy 
to an interview schedule. The interview covers the items on the check- 
list, but not necessarily in the sequence there indicated. 

There are no hidden intentions or "unobtrusive measures" built 
into the intervievr schedule-; the interviews concentrate in a straight- 
forward and public way on experiences, views and attitudes which help to 
explicate a scholarly frame of reference. Session I will be conducted 
in a small group of faculty and students, with one of the co~ investiga- 
tors leading the session. 
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Session II takes place within the doctoral seminar of approxi- 
mately thirty participants, and consists of two parts. It focuses firsc 
upon the problem of investigation chosen by the expert participant and 
probes the formation of the problem, the evolution of the plan of work 
and actual research over timn. The f=^trategies of .investigation and the 
role of evidence in re' are explored. 

In the second ^ jioa II, each expert participan. 

requested to address the. question of the relation between education and 
social inequality in contemporary America in order to propose an investi 
gation which might help to move the current debate forward. All experts 
participating in the study receive a staff paper which summarizes the 
technical debate and the issues involved in it. The points in this pape 
should form the basis from which the problem area is discussed. 

Thus, while the first interviews follow the expert onto his own 
ground and therefore cover very diverse matters, the study converges in 
the last interview onto a common arena. It seems reasonable to hope 
that rather different approaches will be suggested from the different 
perspectives, of participating experts. 

Instruments . 

The study staff has prepared (or will do so) several instruments 
used in the work with each expert participant. They have been referred 
to above and are listed here for convenience: _ ' 

1. A summary paper of the work to be reviewed which focuses on 
the problem of investigation identified by the expert him- 
self in his memorandum. 

2. The checklist for interview I dealing with the expert 
participant's position in the social network of scholarship 
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and his views of epistemological and methodological issues 
(Appendix I) . 

3. The checklist for interview II which deals with the review 
of problem development and strategies of solution (Appendix 
II). 

4. A working paper " Education and Inequality: The Technical 
Issues " which forms the bat. for interview III in which the 
expert develops his proposals for dealing with the problems 
of this debate (Appendix III). 

The role of the seminar . 

The members of the multi-disciplinary doctoral seminar in educa- 
tion participate in the study by attending the seminar and following each 
interview with a brief period of general discussion. They are active 
participants, and have influenced the design of this study. Student 
involvement is important since the pedagogical objectives include the 
preparation of materials the value of whicK^Ts being tried in the Pitts- 
burgh seminar. 

The role of the study staff . 

The two principal investigators, Holzner and Mitroff, together 
with the coordinator of the multi-disciplinary program, Evelyn Fisher, 
and the assistants Charles Teggatz and Todd Simonds, form the staff for 
this study. It is their responsibility to analyze the interviews and 
prepare from them and the other materials used a set of case study sum- 
maries of what has been learned from and about each expert participant, 
and a systematic analytic monograph which presents what has been learned 
from the point of view of the sociology of knowledge. 
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APPENDIX I 

Irasg^gfJReference Interview OiPrkH..^ Scholarly Position .n.jH^ 

1. Briefly, how would you describe your methodological stance? . 
-Do other people in your field share this stance?. 
-What other approaches do people in your field take which you 

consider significant? 
-Why do V fo^ the approach you take to these others? 

2. a) What is the significance of the philosophy of science for your 
own work, your field, the social sciences? 
-What are the main positive and negative contributions the 
philosophy of science has made? 
b) What is the significance of the sociology of knowledge for your 
own work, your field, the .social sciences? 

-Are there positive or negative contributions the sociology of 
knowledge has to offer? 

3. One often hears about dichotomies, for example between "hard" and 
"soft" science, between "objective" and "subjective" approaches and^ 
between "pure" and "applied" inquiry, i^hich of these dichotomies, 
if any, do you believe to be valid? In what respects? 

-Should the issues these dichotomies characterize ,be reformu- 
lated? How? 



4. What is objectivity in social science? 
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5. What do you consider to be important conditions for the possibility 
of valid observations? 

6. How do you see the relationship between theory, observation, and 
knowledge application in social science? 

7. What general body of work has had the most influence on your own 
thinking? 

" career? 

-Any one person's work in particular? 

8. What do you consider to be the domain of systematic social inquiry? 
Of social science? 

-Where do you place yourself in this domain? 

— Can you describe that position by a "label"? 
— Where would you place your? "g^eographiczally" (at the 
center, margin, between two Jiponents, eirc.)? 
-What part of :this domain has had uih- most influence on your owrr 
work? 

— Would you describe this influence in terms of specific 
people? A conceptual framework? A tradition or school 
of thought? • 

-Wliich o-^her sncial science comes closest to your own concerns 
or is of the greatest relevance to you? Which is of the least 
relevance? 
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9. Who are the "great" social scieixtists? 
-Among the contemporaries? 
-Among past social scientists? 
-For all time? 

-Are there "unknown" greats, e.g., under-rated figures? 



10. What do you consider as the greatest contribution of the social 
sciences in the 20th century? 

11. What do you consider the most pressing problems facing the social 
sciences today? 

-Which of these do you feel hamper the growth of the social 

5 ien C3S mos t s i gn i f i can t ly ? 

12. Wher /ou trr!:nk back over your orni career to date: 

— feHZ experiences sharpened your own problem focus? For example, 
rriz^f'.iisziB school, postdoctoral work, fellowships, research 
:~rf gncients, etc.? 

-vftst: '21^3 the most significant contributions you have made? 
WliHt vere the mast significant disappointments- in your work? 
-Us there anything "net done" xrhi^h is now irretrievably lost? 

-^at are sources of frustration - : you? 

co you hope to accomplish in the next five years? 
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13. When you start formulating a problem, 

-Do you start on theoretical grounds (for example, what theoreti- 
cal structure)? 
-Or from data you have collected? 
-Or actions you have had to take? 
-Or historical circumstances of significance? 
-What other factors enter into your prime considerations? 

14. When and under what circumstances have you in the past considered a 
problem you worked on as solved? 

-Please offer some examples, if any, for solved problems. 

-In what sense were these problems "solved" (empirically, theo- 
retically, through a redefinition of the issue, because of shifts 
in historical significance, shifts in interest, or other factors)? 
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APPENDIX II 

Checklist for Interview II; Problem of Investigation and Strategies of 
Solution , 

Note: What is to be regarded as the '^problem" for the purposes of this 
part of the interview is formulated by the expert participant's 
memorandum, his writings, and the staff paper summarizing the work^ 
This interview is designed to explore certain aspects ^^ • 
contexts and history of working on this problem. 

1. Why and under what circumstances did this problem become significant 
tro you? 

-What was the first formulation and how did it relate to then 
existing work? 

2. What is the dx±ference between the initial formulation of the problem 
and the way in which you would formulate the issue now? 

3. If possible, could you please give an account of ths successive 
formulations of this problem? 

-Are there stages in the evolution of your thought about the 
problem? 

-IiJhat considerations were most salient at each stage? 

4. Did the problem remain the "same'' throughout the investigation or did 
its nature change? In what sense? 
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What alternative approaches were considered in the beginning of your 
investigation and successively throughout it? 

-What alternatives were rejected? Why? 

-What alternatives were pursued? Why? 

-What were anticipated solutions? 

-What did you expect to find in different phases of the investi- 
gation? 

Giv^ the history of this problem, would you identify what you take 
now to have been cx±tical decisions with respect to problem formula- 
t±Dn, anticipated ^maution, or strategies of solution? 

-On what grouTTvts were these decisions made? 

-Do you now think that these were correct decisions? 

What is the signiSicance of this problem :and its solution? 

-What would ciianga as a consequence of this project in science, 
in culture, or in society? 

What evidence supports the proposed solution to the problem? 

-What is the relation between successive formulations of the 

problem, anticipated solutions, strategies for solution on the 

on:e hand and rules x>f evidence on the other? 
-Did changes in any of the' former lead to changes in the latter? 

Were _there any critical data in this work? What brought about the 
def i rrirl on of particular pieces of evidence as strategic? 

-What evidence would now lead you to change your mind about the 
srrategic significance of these data? 
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10. Were there any critical decisions in the progress of the project? 
What were they? 

11. Could you briefly characterize your own epistern'"* ogy? 
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EDUCATION AND INEQUALirSf: THE TECHNICAL ISSUES 

by 

Todd Simonds 

with the cooperation of the Frame of Reference people 
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Education and Inequality; TVie Technical Issues 

The continuing debate about education and inequality concerns a multi- 
disciplinary complex of problems, each offering avenues for analysis by 
social scientists • This paper briefly suiranarizes several of the issues 
comprising the debate to provide a problem context for the expert partici- 
pants in the Frames of Reference Study. Proceeding from the information 
provided here, each of the experts is asked to devise a research strategy 
for resolving some issue of the problem. The variety and type of strategies 
generated and the relationship of these strategies to various frames of 
reference in the social sciences are important data for this study. 
The Inequality Problem in General 

The relationship of formal education to social equality is not 
clearly understood for all its importance for the society at large. The 
basic assumption from which American educational policy is derived — that 
equal education is a means for achieving social equality — is regularly 
challenged by the assertion as fact that education leads to greater 
social stratification. The fundamental controversy concerns the nature of 
the relationship between education and social equality, and from that 
issue several major problems are derived. Assuming a priori the usefulness 
of education for achieving social equality, the power of education to do 
this must be measured against other factors that determine the life-chances 
of people, both those factors that are attributes of the individual, such 
as family background, and those factors that are manipulable by policy-maker 
such as income support and employinent laws. Further, the characteristics of 
^qual education, and of good education generally, remain largely undefined: 
"Hirst, what are the educational factors that impact on social equality, and 
«?hat are the means available to educators for maximizing student performance 
on those factors? Second, how can educators compensate for student 
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characteristics that appear to have a negative effect on social outcomes? 
Finally, the distribution of such education xnust be measured relative to 
economic, racial, and geographic groups which obviously poses enormous 
problems of measurement and data reduction. 

The breadth .and... complexlty^af- the problem is reflected in the numerous 

volumes that have appeared in recent years addressing the problem of educa- 
tion and inequality. The following discussion sketches the debate as it is 
defined in five books: James S. Coleman et al,, Equality of Educational 
Opportunity , 1966; Equal, Educational Opportunity , 1968, a collection of 
papers published by the Harvard Educational Review; Frederick Mosteller and 
Daniel Moynihan, eds.. On Equality of Educational Opportunity, 1969; 
Christopher Jencks, et al., Inequality : A Reassessment of the Effect of 
Family a nd Schooli ng in^America, 1972; and Harvard Educational Review , 
Vol. 43, No. 1, February 1973, "Perspectives on Inequality ." The issues 
addressed by these works are organized according to a framework provided 
by a work in progress by William W. Cooley and Paul Lohnes entitled 
Evaluative Inqu iry in Education. 
Evaluative Inquiry and the Debate 

Beneath the political, moral and ad hominem cant that has followed 
the publication of these works lie two critical problems facing the social 
scientist: the clarification of values and the clarification of facts. 
Cooley and Lohnes offer a model for evaluative inquiry that especially 
treats these two problems, and is particularly useful as a conceptual schema 
for organizing this debate because it permits a partitioning of the issues. 
A part of the debate, essentially outside of the realm of social science, 
concerns the policy interpre tations of the information provided by these 
authors; within the realm of social science, and the focus of this discussion, 
is the intarpretability of the information: Have the authors organized 
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their inforaation according to the cannons of evaluative inquiry? Cooley 
and Lohnes discuss at length two critical aspects of evaluative inquiry: 
valuation and modeling. Around these two aspects much of the debate cen- 
ters. 

Valuation . Valuation is the generation of value-laden operational 
propositions against which the phenomenon will be measured. Cooley and 
Lohnes develop their understanding of valuation from a theory of valua- 
tion proposed by John Dewey in his 1939 entry to the International Ency* - 
clopedia of Unified Science. Dewey contends that value statements do not 
comprise an absolutely distinctive class of propositions. Rather, any 
useful value statement is a proposition "stating relations between things 
as means and other things as consequences, which relations are themselves 
grounded in empirically ascertained and tested existential relations such 
as are usually termed those of cause and effect" (p. ). Such state- 
ments generally assign "a relatively negative value to existing condi- 
tions, a comparatively positive value to a prospective set of conditions; 
and intermediate propositions intended to invoke activities that will 
bring about a transformation from one state of affairs to another" 
(p ). Further, means and ends are not absolutely distinct, but are 
"arranged on a continuum such that each condition is a 'means' relative 
to those conditions that follow it and an ''end' to those conditions that 
come before it" (C-L, 1.3-5)- Values are statenients which "direct the 
flow of behavior at any time" (C-L, 1.3-6). Value statements as goals 
must be regarded as tentative and testable as means to a subsequent goal. 
Any piece of evaluative inquiry is obviously lltnitied to one segment of the 
means-end continuum, but the principle of the goal as tentative and 
testable yields the principle that "clarification and transformation of 
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aims or goals of education will be a resultant of, not a prerequisite for, 
evaluation research" (C-L, 1.3-10). 

Modeling , Evaluative research is a cross-breed of experimental 
and naturalistic correlation research, both in the theoretical knowledge 
upon which it is built and the procedures employed. Two procedural ele- 
ments especially give a quasi-experimental shape to evaluation designs: 
sampling procedures which create intended or unintended differential 
treatment groups, and the statistical manipulation of variables creating 
intended or unintended hypothesized causal chains. Cooley and Lohnes 
propose two principles of statistical modeling for the evaluation re- 
searcher: the sample unit and sample structure must reflect the natural 
reality under examination, and the data reduction techniques must not 
impose a hidden relationship among variables. Relative to sampling, most 
educational research has favored the individual as the unit of analysis, 
arguing that it is the individual, not the aggregate, that learns. 
Cooley and Lohnes argue that this predisposition is an unfortunate one, 
first because the school "class" as an aggregate is a particularly mean- 
ingful unit in American education, and, more generally, the sample unit 
ought to be selected on the basis of testable assumptions about the unit 
in which the critical variable will in fact vary. Too often, they con- 
tend, technical sampling brilliance wins a victory over common sense. 

Concerning data reduction techniques, Cooley and Lohnes prescribe, 
first J the use of a small number of linear combinations to represent the 
multitudinous measurement items in foyr primary measurement domains 
(learner characteristics, learning outcomes, contextual dimensions, treat- 
ment dimensions), and, secondly, the independent allocation of portion 
variance to each domain accompanied by the identification of "confounded" 
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variance as a function of the real interrelatedness of two or more 
domains. Confounded variance in their model is not a statistical entity; 
it is rather a statistical measure of the natural complexity of the 
phenomenon. 

Valuation Aspects of the Equality Debate 

The valuation portion of the technical debate concerns the trans- 
formation of an abstract notion — equality of educational opportunity — 
into an operational proposition and the relationship of that proposition 
to other socially-valued propositions in a means-end continuum. The con- 
tinuum that has emerged from the various research programs may be de- 
picted as follows: 

1. Equalization of educational resources available to all child- 
ren yields equalization of achievement outcomes. 

2. Equalization of achievement outcomes yields equalization of 
employment opportunities . 

3. Equalization of employment opportunities yields equalization 
of income. 

4. Equalization of income yields equalization of access to 
socially necessary and/or desirable commodities. 

Proposition 4 remains untested within the parameters of the research in 
question.,h©re. Coleman attempted to test Proposition 1, while Jencks 
attacked each of the first three. 

In a retrospective essay in Mosteller-Moynihan, Coleman discusses 
the thinking of his design team as they attempted to operationalize the 
concept of "availability of equal educational opportunity," the object of 
study as mandated by Congress. Five alternatives arose: 
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a. inequality defined by degree of racial segregation; 

b. inequality of resource inputs from the school system; 

c. inequality in intangible resources such as teacher morale; 

d. inequality of inputs as weighted according to their effective- 
ness for achievement; 

e. inequality of output as prima facie evidence of inequality of 
opportunity. 

The group opted for the fourth, which definition enabled them to rephrase 
Proposition 1 in^operational terms: equality of educational resources is 
that arrangement of resources which does not prevent equalization of 
achievement outcomes. They found, of course, that after controlling for 
family background, the current arrangement of resources as measured by 
the study did not prevent equal outcomes, that is, could not account for 
the outcome inequality. 

Economists John Kain and Eric Hanushek contend in the same volxmie 
that the decision to pursue this line of research distorted the purposes 
mandated by Congress, and in fact led to the gathering of evidence 
insufficient to meet the Congressional mandate. They argue that Coleman 
should have ignored the relationship between resources and outcomes and 
concentrated on the measurement of inputs available to different groups 
of students: 

In attempting to do all three (input survey, output survey, 
process research) the authors of the Report failed to pro- 
vide convincing answers to the question of whether minority 
groups are systematically discriminated against in the pro- 
vision of educational resources (M-M, 118-9). 

Coleman replies that: 
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by selective atte xtion to one of the definitions of 
equality of educational opportunity, it implicitly accepts 
and reinforces that definition. ... In contrast, the 
major virtue of the study . . . lay in the fact that it 
did not accept that definition, and by refusing to do so, 
has had its major impact in shifting policy attention from 
its traditional focus on comparison of inputs ... to a 
focus on outputs, and the effectiveness of inputs for 
bringing about changes in output (M-M, 149-50). 

In effect, Hanushek and Kain argue for the empirical measurement 
of one clause in a value proposition as manifest in the nation's schools, 
w.'iile Coleman and hi^ colleagues set out to test the means-end linkage, 
the reality, of the proposition itself. Cooiey and Lohnes have suggested 
that the latLer approach is the ultimate outcome of evaluative inquiry, 
but the debate continues as to whether the inquiry should be designed to 
that end or to the narrower problem of measurement. 

Edmund S. Gordon (M-M, pp. ), summarizes a different stream of 
criticism related to valuation; that which derives operationaJ defini- 
tions of educational opportunity from the fundamentals of the learning 
process, rather than f rom the physical and monetary outlays per pupil. 
He cites four positions: 

Melvin Tumin : Equal education consists of "equal pleasure ex- 
pressed by the teacher x^ith equal vigor at every child's attempt 
to become something more than he was and equal distress at every 
failure, with equal rewards for all children. 

Ralph Tyler : Equality of educational opportunity is equality of 
the meaningfulness, stimulation and conditions of learning. 
Susan Stodolsky and Gerald Lesser ; "Equal opportunity is pro- 
vided if the school makes maximum use the distinctive pattern^i 
of ability the child possesses." 
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Kenneth Clark : ''The best expressions ot (ideurif iable essential) 
"features (of good education) should be ^made available to all 
children alike/* 

These definitions f educat:'' aal opp ^rtunity a: : iir more sensitive rc tht^ 

dyna^^L-^"^ of leamin.. :: le resourrce measures ui^^d by Coleoan (his zinc - 

ipi-r cvm 36 rephrased as "vnere's a fairly ^..jall distribution of things- 
Ztzz 4of./t count /*)^ furrner, the discovery inaqualities of this sort 
WOL I ave the effect of redirecting policy iizo; qc^ntilrative tc quaLLta- 
ti^ji:* p/rogram measures. This is essentially t u-. ^ducatijonist parallel to 
the petition of economi£::ii5 Kain and Hanushek- 

Jencks launches :riis argument: from another dilrection., attempting to 
measure the accuracy of the chain of propositions noted above. If equal 
educational opportunity is proposed as a means to equality of income and 
status in the adult world, he argues, we should test its efficacy in 
achieving that* Because he found only ^'modest relationships between cog- 
nitive skill and schooling on the one hand and status and income on the 
other*' (J, 11), he concludes that egalitarian policy should be aimed 
directly at equalizing income, while school policy should be concerned 
with the quality of life in the schools. 

Coleman and Jencks, then, see as the problem the testing of one 
or more of the means-end propositions, while the other positions summa- 
rized here argue that the first problem is to generate a sounder defini- 
tion of educational opportunity, then measure the equality of its distri- 
bution, leaving the process validation to subsequent research or asiiump- 
tions. The question remains open as to which perspective, or others not 
cited, best provides information for decision-making. 
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Modalltpg ^^tpg^cts- of the Equality Debate 

>H&T.y rS Che arciclss critical of the Coleman and Jencks reporcs 
have .:/oY.: ^ent:rmi>J cm technical deficienc ' f the research p-cn^rams, 
conclude . 1 --^._.-h deficiencies render ai conclusions tenti.. .ve at 
best. '^wc. .rr-^-rical technical aspects l_ . sampling and st^axlstical 

modeling i he iiiae. • .->ds by which the research^irs ccnstruct the ~i enomena 
under scrrarini :-ie points of contention of each of these aspects for each 

of the tj^/ .-.s ^'i: isoinmarized below: 

/i^t . ^'^^"^' ^^ Sample . Kain and Haniu£nek (M-M, 119-23) present the 
most det; ^- -r^lcism of the sampling prc^c^dure employed by Coleman. 
First, tr f. its-:. :-.tly large sample (569,000 students) is ser:* usly re- 
duced bee -xka^y did not obtain input data for students. The school 
sample ic -r -lusiy reduced if stratification is desired; for example, 
there are or-Iy fDur urban Southern schools with a non-white student popu-r 
lation berwe^n t^n and seventy-five percent. Secondly, non- response or 
faulty res^JiizHie -liminated 51 percent of the high schools. While it is 
easy to i iri r- ^i-r^ ^ systematic bias related to resentment of the Congress- 
ional motlTxsc. ; jiur ~ bias was not examined. Similarly, non-response to 
sensitive cussr^irns was unexamined; one third of the northeastern ele- 
mentary pr±nc:=ral£s, for example, failed to answer questions concerning 
their attinird^ tr:::7ard the racial composition of their schools. Further, 
the questionnaire did not seek qualitative assessments of r:2sources or 
information concerning school organization or the histories of students. 
Finally, th-c _^u.oci3 atteiided by minority students were vastly over- 
rep re-sen tedw Iir: shcrt, th^y contend that the Coleman study was based on 
inadequate f nfomiatlon about an unrepresentative group of schools and 
individual 
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rh=± Jencks Sample . The criticism of the Jer ;s sacsile _is two- 
fold and straightfoTO-ard: "Jancks^ analysis . ^ . ^rarnatrH^ d^ata on 
blads: people altoget:::z3r, and includes only 'nati'-^^ b: m whir:^ Tion-farm 
men'" (Edmonds, ^ al. , HEE, p. 88); similarly, T.-r-: : and p3:L,.:'ple bom 
since 1935 are excluded fmm the data used for raos ' : the ccznputations 
(Rt^lin, ESR, p. 72). The racial and sexual homog.^ ^-Xy of dhe sample 
excludes large numbers of wage earners whose inco^ .:.r_Hquali-r7 is espe- 
cially visible, and the birth cut-off excludes everr.,. .idy who -went through 
the public schools since the mid-nineteen fifties, a t>.eriod many educators 
recognize as the point of emergence of modem educi:r=:^3rnal practice. The 
Jencks data then cannot answer two critical questicms: What doers school- 
ing do for groups that have suffered special employment bias:esT and What 
do schools as they are now run do to income patterns? 

The Coleman Statistical Mode. !. The most comprehensive re-^analysis 
of the Coleman data employing, different modeling procedures was produced 
by Mayeske, jet^ al . , and published as Our Natio ii 's Schools , 1969. The 
authors organized the many Coleman predictors into a small numbex of scales 
and replaced the step model with a ''commonality" model (C-L, 6-3. 1-2). 
In the step model employed by Coleman, family background data had been 
entered first and allowed to account for as much of the variance as it 
could. The other predictors then parcelled the remainder of accountable 
variance, leading to the striking conclusion that schocl characteristics 
matter —ery little compared to background characteristic^ . Rayeske sought 
to determine which parts of the variance could be uniqinsC-^r attributed to 
backgronnd and school characteristics, and which part was aLc.::rrant£d for by 
their indivisible co--action. They found the following: 
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Unique from Bac imd 
Unique fror: :Hchr 

Commonality cf j^rounc. • adi ^chool 
Unexplained Vari^ 



. 11 
.15 
.71 
.13 



Iw'Qley aa.id Lohnes concluJe chat rindings "dramatLr^^ me dilemma thar 

is^rlcHi: public s^ch>ivQls operate ^icu^ unction ^rith zhe: zz^-l^Hqs and nei^: 
hrr±oo.::^j to which they ar^ 3ymbi orlc-i' : mated . . . c~ie be pessiaiii:,t 
^mrut rhe utility of pouring inon=ry in^c schools in "^ociz iiiai£ihborhoods 
w±thoiit operating cnn the other fz^ctor^ sn the marriage" (C-L. 1.4:11-12). 
Tnls r:ed±rection of p:oteiirlal poILicy decisions stems, they contend, from 
the greater degree to which the Mayeske statistical model reiH-eccs the 
reality of American education. 

The Jencks Statistical Model . Two streaHLs of ::ri:: « • jjsm have been 
directed against Jcrncks' statistical model as explained in rJjs Appendix 
E... a disciussijr. of his path model for analysis. The first 3i::ream relates 
tc: the podicy concliision Jencks hiimself draws. :Stinch corbe y Science ) 
criticizes him for hzLS emphasis on unexplained variance as an operating 
factor in determining life success. Against Jencks' reifi::atzon of *'luck" 
Srinchcombe says that ^'comparing a real cause in the world with the stro^ig- 
est cause one can inagine, rather tban with other causes actually operaL- 
ing, gives an artificially deflated estimate of the importance of the rc 1 
cause. ' Hhus it seEns to him more luseful to compare the effects of sc^ iH- 
ing on icicome with zzj.e. effects of orrher measurable factors excj.uding 
ciusiace , or unexpl,: ...ired Vuiclance. 



patb model and to the f ac: : rhiat he apparently teste- on ! • one of the 
inrr^jmerable models one coxHd construct from his var-^able^^ . Stephan 
Michelson, one of Jencks' collaborators, writes in the I^EF. that Jenck; ■ 



The other, more aorr^iex, crzLlicisms relate no th^ accuracy o 
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siiCi5ticai deDomstrati-jr inrelate-d to any model of the ecoaomy that 
_ rs=Ls-as aciucational at r - irm ^r-?- and income, whil^. "a number of plausible 
m dfel£ ^sQgest that the pr -...-t econcmy requires approximately the amount 
C-. iir^cc-- inequality we fiz_. t". presen-. Jencks needs, at least, to 
£scab^_3ii a model in which structure of schooling affects the struc- 
turs or iaLODse, and predict - a value of the school- income correlation so 
ws -H? aiL'_=rmne W7hether it ...as this value" (HER, p. 98). The alleged 
tB--..., ,a2 deficiencies of ch^ path model — nonlinearity of some relation- 
ships, iirceraction of variabiles and missing variables (discussed at length 
in — Jencks meets he_- on aad rejects, in part because he tested for 

linvrtaritrj,- and interactions, £and in part because the effects of the defi- 
cieHcies would nave been to -nflate the apparent values of family and 
schooliog; thus his values ror these variables are probably larger thar. 
thpr- wouli::: be if he listened to his critics (HER, p. 148). 

ij- to other 'jnexamir-^; d models, two defenses are raised, cne by 
•Tencxs irr. the book and one bv- one of his critics, Alice Rivlin, in HER . 

cks defends trie selection of his single model for analysis as one taken 
i:::xectly from l>;ls nud_£. Duncan's "Ability and Achievement" (Jencks, p. 
and is grzz=-Aed, f-els, in both empirical tie^-ing by Duncan and 

r=.n a -ejrnmonsens- cal r ;o-ciu.3is about Iiow the variables are related to one 

-natCHrr. His goal vss nc - to test the validity of various models; it 

romputs ace— a: - -al:-s for what he felt to be the best model, 
-==t-i— ; altfir:-ativ= .. ants when they suggested thems-.; ves . Rivlin's 
de; 3Ti=e derives fnz- her nozion of Inequality as an exa^iple of "foreasic 
soriaC-cience," a new tradition in which "scholars . . . take on the 
meir rsask of writing briefs for or against particular policy positions" 
(EER, p. 61). Jencks' self-assumed task was to reject the prominent modeJ 
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relat±ng schooling t. inc : and it \^asi thus L:3g Ltimane fax him to con- 
centxa±e cn that mod-i, iiL -ffscr to ac;:t:ack the propositicnal chain, 
rather thEn trying tc re car: : zh^ v^ariables in nt^w ,..^dels a^: in more :i radi- 
tianal research. 

Coaceived as a c,^s^ f evaluiative inquiry, and analysed accord- 
ing to the principles t - 'j/:h .i:uuij:y ., t:he .cni. iex ^ite cj:iacerning 
equality erf education* Qr:vp^^>rz^2-ity ajssximei a ijoniev/h&c more manageahil^e 
strucDure* The issues of ^/SLLaarion — comiLng to grips with the meaning 
anc mechanics of equal educ^;nr±on — and Tnodeling — rme development of 
s tnrl 5?t ical processes reflecrlng the reality of schocling — provide two 
poles for organizing t'ne debrsste. The yieLd of this analysis is a small 
number of technical asstertzinions and ccnnxlner assertxczLS, suinmsri2ed here: 

a. The proper design: for a stuciy of educiational inequa3J.ty is one 
which measures :::rie distributaon of resources vreightcd ac^*iM:J- 
ing to tiieir ef f Ttiveness for achLt^.v^meut. 

versus 

The prop:..- -.'^sir-n would first measure in d£±ail the di^^*.t:ribu-- 
tion of : ^ .^rceSn leaving proc£2f.<s res-arch as a subseaut;^r:r 
undertraiii 

b. Ediicnsricrrii^ ern:uaHT7 is achie:^ed throut -i equal disrribu" 

of ;7?'sij:.i-^, inxinetary and personnel resources. 

versus 

Educarion^l equality is achieved through attitudinal and 
process variables applied equa^j • for all childreii, bu? 
differentially according to the chsract£_:istico -.rf r.;e tuiJ^d, 
r.. Education can a priniary -raad to socliil eia;uality, and 
trrerefore educational policy should be aimt at equal 
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distribution of inputs with the goal of equalizing out- 
puts . 

vers us 

Educational attaimnent has anly a modest relationship to 
social equalitj-, and therefcxe educational policy should be 
aimed at other goals, such a;:= i-niproiring the cualiry of life for 
the children B^md adults in tiris. schools . 

d. The samples us^d by Coleman ami. Jencks are t^no unrepresentative 
to support anr conclusicms dra»^ji from then. 

e. The data rsiorcrrjDn techndques employed by Coleman impose a 
critical bias or:: hrs findingsr:; diJEferent re^j^lxniques result in 
quite dif f i:::-::^ nr cot^clMsloms 

f . The path moda-. e:imployed by JsTrciiis demon^trratei^^. tlvtf: ^^light 
effects cf ed-irj?'ti:an :)n iracoicE aaaility . 

r:5 us 

The model is ■:s:::z .zii^^^d tjz any •:i!.'rdel of rrh^: -^i- n.omj' which in- 
cludes educatiicr. grni; is zher^cnxe nnarie r^-" - ':or drawing 
ccnc-lusioni2 t^.^a.-^ to t^i- eiL:ra:anic effecticre- .ss of school- 
ing, 

and 

While the path m .^del show£^ oinlr slight effect^ for schooling, 
schooling -las .1:::^- largest efz^:^t o' an-; rfc^.l : -:tor measured, 
and is a rr:.-~T,:zry zzxge^z fcr c alii:iarlan pc^ Lc". 
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WORKING PAPER ON THE CONCEPT 
FRAMES OF REFERENCE 



PROBLEM 

He know that men "make sense" out of the environments they face by 
selectively and through symbolic constructions defining (interpreting) 
them as situations. The predispositions and cognitive repertories 
drawn on in this process of interpretation we will call "frames of 
reference"; the specific subject-object relation within a defined 
situation we will call ''orientation," 

Devising methods for the systematic, empirical study of frames 
of reference and orientations appears important, because they link 
presymbolic cognitive predisposit j,ons to symbolic repertories, and 
(through their institutionalization) individual modes of defining 
situations to those required by roles and institutions (especially 
in relation to "epistemic communities; sets of roles requiring 
application of similar epistemic criteria). Thus, the empirical 
study of frames of reference is likely to be of strategic importance 
for the sociology of science and of knowledge, as well as for 
cultural sociology generally. The following steps appear necessary 
in order to arrive at methods for the study of frames of reference: 

1) exposition of the concept itself; 

2) exposition of the components of frames of reference as 
dimensions of expected variation; 

3) exploration of the degrees and ways in which frames of reference 
become observable objects as against observer constructs; 
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4) exploration of alternative approaches to measurement (not 
attempted here) . 

THE CONCEPT "FRAME OF REFERENCE" 

The interpretation of environments into situations (i.e., the 
construction of meanings) is always the activity of a subject 
establishing more or less determinate relations between an 
"experience" and 

a) the subject — thus typically constructing the "experience" 
as a symbolically representable "object" 

b) other objects and their relations. 

This activity proceeds on the basis of assigning the subject- 
object relation ("orientation") a location within a "space" of 
coordinates, in the most simple case a physical frame of reference 
locating observer and object in time and space. More complex 
orientations are embedded in an obviously multi-dimensional, socio- 
cultural context. 

These contexts are describable in analogy to descriptions of space- 
time locations. In relation to the process of interpretation, however, 
they function as the taken-f or-granted anchorpoints, establishing 
a frame to which a specific orientation is related or referred which 
then can be represented as "meaningful." Further, we are here 
concerned with symbolic interpretations, which involve the selection 
of some symbol system as appropriate for the representation of the 
experience. The structure of the preferred symbolism both enables 
interpretations to be made and constrains their possible variation. 
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The necessary conditions for the process of intepretatlon thus 
include the experience of a subject; a system of taken-f or-granted 
coordinates within which subject-object and object-object relations 
can be located; and the selection of a system of symbolism as the 
taken-for-granted medium of cognitive operationsv^ These conditions, 
together, constitute the "frame of reference." One could describe 
them in analogy to Kantian *'a prior is," of course with the under- 
standing that in distinction from- Kant wide variability of these 
functional a prioris or taken-^for-granted contexts of interpretation 
must be postulated and investigated. 

There exists a large literature relevant to this subject, e.g., 
Dilthey^s psychology of world views, Jaspers' more elaborate 
contributions to the same topic. Pepper's notion of "root metaphors," 
Thompson's, rather cursory, look at the sociology of "truth 
strategies," the work of Singer, Churchman, etc. The systematic 
assessment of the yield of this. literature for the present issue 
requires a paper. 

3. COMPONENTS OF FRAMES OF REFERENCE 

The following analytic ^^components" of frames of reference are 
listed as separate because they appear, in spite of a high 
degree of interdependence, capable of some independent variations; 
however, they are to be taken together in any description of a 
particular frame of reference and the cognit-ive operations (modes 
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of inquiry; processes of interpretation) occurring within it or 
across several frames of reference. The components are 

a) preferences for the selection of the experiential base; 
(preference system); 

b) a scheme of categories into which selected information 
can be tentatively ordered; 

c) a "model'* of the domain to be inquired into tentatively, 
but selectively, indicating expected structures and 
relations ; 

d) preferred modes of explanation and a repertory of theory; 

e) preferred types of reality tests; 

f) preferred rules for the mapping of alternative frames 
of reference. 

These will be briefly discussed in turn. 

Preferences for the Selection of the Experiential Base 

One function of inquiry is always to reduce uncertainty, or 
even to produce certainty. There are clearly different bases 
for the attainment of certainty, here used as a term describing 
the state of an experiencing subject. They include such things 
as the certainty of revelation, of mystical states, of public, 
empirical observations, of self-evident first principles, and the 
like. The notion is here advanced that the as yet unreflected 
and in that sense pre-sjnnbolic commitment to a particular mode of 
experience as a source of certainty becomes the major determinant 
of the preferences for the selection of experiences to be 
symbolically represented as data (information). Examples abound 
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illtxstrating the fact that inquiring subjects differ, often predict- 
ably, in their selective attention to data of various kinds. The 
predisposition for such selectivity will be called preference system. 

However, the underlying commitment to a particular mode of "certainty 
experience" influences not only preference systems, but also highly 
symbolically structured, and reflective cognitive operations in the 
process of interpretation, and reappears in sjnnbolically defined form 
under the heading of "reality tests" which relate a "proof" as expla- 
nation back to a compelling source of certainty. 

In relation to the preference system one aspect that needs to be taken 
into consideration is the source of the original uncertainty which is 
to be reduced. This may well be of a primarily cognitive or action 
variety, relating the preferences for new information to a base of 
specific information needs. 

3.2 Categorical Schemes 

Data and information, once received, must be organized, related, and 
stored. A major, and apparently universally appearing, mechanism is 
the tendency to organize data into and in relation to structured set 
of concepts — which will be called the '"categorical scheme," being a 
general framework for abstraction. Again, examples are plentiful; 
it is not difficult to describe categorical schemes for major disci- 
plines (e.g., concepts around "role," "social structure," etc., in 
sociology) or for particular thinkers. It is important to note that 
these schemes operate with a high degree of abstraction. The differ- 
entiation and structure of such schemes are, of course, variable and 
ranging probably from simple dichotomies to most complex systems. 
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3.3 "Models'' 

Categorical scheme and what is here called "model" are rather 
closely related, in that the "model" is an image of the relations 
expected to exist in the domain under inquiry. Often "models" 
are analogies extended from the familiar and convincing domain of 
knowledge to an uncertain and unfamiliar one» Pepper's notion 
of "root metaphors" - metaphoric applications of the familiar to 
the unknown - which give rise to "world hy''t)ath^es" is closely 
linked to what is here meant by "model." 

3.4 Some Comments on the Foregoing and Following Points 

This discussion of the components of frames of reference progresses 
from issues relating to the pre-symbolic experiential b"ase of inter 
pretation (inquiry), through the treatment of matters ''relating to 
broadly sensitizing and organizing symbolic processes, to the 
sharply crystallized sjnnbolic interpretation that is an explanation 
or even a "theory," and then back to the experiential base in 
symbolically defined operations. This far the broadly organizing 
contexts have been treated; now specific modes of symbolic construe 
tions of interpretation will be mentioned. 

3.5 Preferred Modes of Explanation and Theory Construction; Repertories 
of Theories 

Explanations relate a specifically interpreted object, or better 
an event, by means of. a theory to a compelling base of certainty. 
Their construction involves always, but in varying degrees, 
s3mibolically highly disciplined operations which relate the 
explanation through a compelling mode of "reasoning" to what 
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is already taken as "known/' The matter has been explored in 
the philosophy of science and a rather wide range of modes of 
explanation and theory construction have been found. There is 
every reason to suppose that not only scientists and philospohers 
explain things and build theories, but that their preferred 
modes of explanation and theory construction are a subset of 
those in use in social life generally. It appears that, as yet, 
there is no systematic attempt to explore this full range of 
explanatory modes - which certainly would include causal, deductive, 
genetic, etc*, explanations as well as those relying on notions of 
"agency" rather than cause, on symbolic correspondence or similar- 
ity and the like- 

The labor of constructing interpretations in an explanatory mode 
is heavy; clearly there are tendencies to rely on established 
repertories of theory and even repertories of pre-established 
specific explanations. Roles and institutions contain as an 
important component such repertories. 

3.6 Reality Tests 

Interpretations, constructed in such highly symbolic modes, 
while always arising out of some preferred experience, have 
so transformed raw experience into complex constructions that 
the need to "check" them, refer them back to a base of certainty, 
arises inevitably. Occasions for such checking, performed in 
a structured mode, are "reality tests." Some arise inevitably, 
as an explanation is used in a predictive mode and i§ either 
confirmed or not. Others are deliberately sought. Again, the 
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matter has been explored in the philosophy of science — albeit re- 
strictively. Considerations of empirical tests refer to only one type, 
to which must be added a wide range such as deductive tests (as dis- 
tinguished from deductive explanations), tests by referral to authority 
or "trust," by situation control (or selective sampling) and the like. 

One major context for the testing of interpretations, even theories, 
derives from the anticipated or actual context of their use. In the 
context of cognitive use knowledge is used, as in institutionalized 
science, for the ot. ^janization of existing information and the creation 
of new knowledge. In the instrumental use knowledge is applied to the 
calculation of effective means for reaching a goal; in ideological 
use assertions are applied to legitimate or delegitimate specific 
claims in the mode of action justification. Or finally the antici- 
pated domain of use may be. incorporated into "common knowledge" 
enlightening the citizenry of a body politic. 

3. 7 The Coherence of Frames of Reference 

It appears plausible that variation in one "component" of frames of 
reference is compatible with only a limited range of variation in ' 
others, giving rise to the phenomenon of relatively coherent "cogni- 
tive styles" — but this matter cannot be explored here, since the first 
emphasis might well be on the exploration of the kinds of variation in 

^ these components, and the ways in which they can be measured and 
described. 



3. 8 Trans lat ability of One Frame of Reference into Another 

Only a word on this point: all frames of reference can be, in prin- 
ciple, mapped into each other, but always with some information loss 

46 



Page 44 



and other "cost." This point has implications for methcK^ which 
should be explored. 

FRAMES OF REFERENCE AS OBJECTS 

It is fairly obvious by now that frames of reference are learnable, 
i.e. I can be transformed into symbolically articulated "cultural 
objects" (Omar Moore's concept). However, a very wide range of varia- 
tion along this dimension exists from the unreflected, undifferentiated 
"point of view" of, say, a peasant, to the reflected upon, differen- 
tiated, symbolically articulated and maybe even authoritatively codi- 
fied frame of reference of a scientifically trained agricultural exten- 
sion agent.. This matter might be treated In analogy to E'.iu^iiLley * s 
treatment (following Campbell) of degrees of entltiv.lty of suDcial 
aggxegsres; it is obviously a point of major methodal>^cal import-, 
ance, Esince the empirical study of frames of reference :sans that the 
invest±gator must learn some things about them from h±s respondents — 
the modes in which this can be done will differ in large ways depend- 
ing on the degree of articulation of the frame of reference and the 
consequent modes of communicability . 
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FRAMES OF REFERENCE STUDY 

The "Frames of Reference Study" is a detailed exploration of a 
few selected perspectives and modes of investigation which have proven 
significant in certain social inquiries. It is carried out in the con- 
text of the Pittsburgh Multi-Disciplinary Doctoral Program in Education 
and pursues both educational and research goals. A procedure of inter- 
viewing experts who have conducted major inquiries is used in order to 
denonstrate altematiT^ in problem formation and strategies of investiga- 
•t±arL, both in principle and. in concrete example. A systematic method of 
xiisiroverlng and descriMng the experts' frames of reference is applied. 
!!3ie work explores procsses in the production of new knowledge and pre- 
snrs to students tools: and principles for dealing-with the multi- 
perspectivlty in social, inquiry. 

This working paper describes background, goals and procedures of 
the study to participants. The appendices provide the interview check- 
lists, a paper on the current debate concerning education and inequality, 
and a background working paper on frames of reference. 



49 



Page 2 

INTRODUCTION 

This investigation, whixJi we call the "Frame of Reference Study ' 
grew out of a convergence of practical needs and theoretical interests* 
About a year dgo Hol^ner and Mitroff in collaboration with Richard Con-~ 
viser and several graduate students held informal seminars to work on 
basic issues in the sociology and psychology of science. These seminars 
soon concerned themselves with the question of the properties of modes of 
inquiry and the reference frames of cognitive activity generally. Scien- 
tific and scholarly ways of inquiring were analyzed not so much in order 
to improve scientific methodology but to shed light on the construction 
of understandings generally, including those involved in folk methods and 
folk theories. 

The same colleagues worked together in the multi-^disciplinary 
doctoral program in education. This enterprise, sponsored by the Learning 
Research and Development Center at the University of Pittsburgh and funded 
by the National Institute of Education, brings together advanced doctor^tl 
students from a variety of academic disciplines, such as anthropology, 
economics, history, sociology and others, in order to provide them with 
opportunities and encouragement to apply their skills to the study of 
educational problems. The students are working either as fellows or as 
research assistants on special projects of • this program; their depart- 
mental dissertation advisors ^participate as well. 

The work of this group includes a continuous research seminar in 
the deliberations of which there soon arose questions about alternative 
modes of inquiry and the transferability of concepts and methodologies 
..from one intellectual context into another. Under the initial director 
of this program, Ian Mitroff, much attention was paid to the nature of 
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modes of inqinirry and thsir reii^ation to s^v^&ct matters, .aird to each other. 
The current jiirector of the progranL, Paul JLazarsfeld, focuses even more 
specifically on the question of the. .transfer of methodoli^zzies and concepts 
across disciplinary lines, as it is often demanded by ttezneeds of 
applied research dealing with such multi-faceted issues as those arising 
in education. Lazarsfeld suggested ^as a fruitful pedago^'ixal procedure 
the expert-expert interview in which one scholar conductrs^ a searching 
interrogation of another investigator, in order to demainnrrate to the 
seminar audience just how a specific kind of scholarly ±ini:uiry has pro- 
ceeded. 

Multi-disciplinary i:ducation is always difficult and risky. This 
is especially so when it tries to enable students to acquire special 
skills for conducting rigorous and serious work in future iiv.ulti-discipli- 
nary research settings, the structure: aind tasks of whzck camiDl be exactly 
foreseen. It therefore seenis to be s: pedagogical goal of some importance 
to concentrate on methods f or the sys±-eEEatic and thorough ^understanding 
of alternative intellectual approaches aad modes of inquiry. If such 
reflection is undertaken in close relation to the investigation of shared 
objects of inquiry, it should help to produce both more di.sclp lined and 
skillful observers and procedures for graduate; education. 

The frame of reference study, desi^edi in this context, therefore 
has simultaneously pedagogical and research goals. It is, essentially, a 
procedure for investigating the structure of approaches taken in social 
inquiry? The general goal is to validate the procedure itself -and show 
that it is appropriate for studying the context of assumptions, often 
taken for granted, within which problems of scholarly inquiry are formed 
and strategies for solution developed. A small number of scholars, each 
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of whom has conducted investigations 
invited to participate and make some 
analysis. 



resulting in new knowledge, are 
aspect of their work the subject of 
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RATIONALES 

By "Frame of Reference** we mean the structure of assumptions and 
dispositions whidi form the context within which inquiries proceed and 
knowledge is arrived at. These assumptions include epistemologies and 
methodologies, schemes of categories into which information can be at 
least tentatively ordered, often a ''moder* of the domain to be inquired 
into, preferred modes of explanation and theory, tests of knowledge and 
anticipations for the significance of the knowledge to be found in theory 
or use* We expect that a finite typology of reference frames can be con- 
structed and that systematic rules for mapping them can be designed. 

Understanding the activities involved in the production of new 
knowledge seems to us to require a concrete and specific understanding of 
reference frames. This approach should avoid both the errors of psycho- 
logical reductionism and of stylized textbook methodology or publication 
conventions. Psychological reductionism sometimes, in its extreme forms, 
seems to dissolve knowledge into highly per&onal productions of persona- 
lity mechanisms, and the stylized image of science and scholarship tends 
to obscure the dynamic reality of problem formation and solution. The 
investigations of the frame of reference study therefore focus on the work 
of knowledge production and its requirements, and on the social role of 
the scholar in a very concrete sense. The methodology of interviews con- 
ducted in the semi-^public setting of interview groups and seminars follows 
from this rationale. 

Two broad aspects of scholarly activity are studied: the loca- 
tion of the scholar in a social network involving colleagues, sponsors, 
and audiences, and in relation to historical events or trends, and the 
formation of the problem of inquiry itself and the demands resulting from - 
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it. Both aspects are interrelated, but they become the somewhat separate 
foci of two phases of the interviews. 

Among the pedagogical rationales for this study is the conviction 
that fruitful work in modem social inquiry requires awareness of alterna- 
tive modes of inquiry and of the relations of observers and objects in 
these contexts. Highly abstract representations of the more or less 
institutionalized frames of reference of the major disciplines do not seem 
to help much since such matters tend to be depicted rather schematically. 
Instead it seems useful to devise a pedagogical method which provides 
procedures for understanding alternative reference frames. This may lead 
to more sophistication and skill in the transfer of concepts and methods 
from one context to another. One of the most difficult accomplishments 
of graduate education is to teach skills in recognizing and forming 
significant problems. The careful preparation of case studies, resulting 
from the interviews conducted in this study, should be helpful. 
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OBJECTIVES 

The frame of reference study has both pedagogical and research 
objectives. While they are analytically separate, they are also clearly 
interrelated and are here presented as a single list. 

1. Clarification of the notion "frame of reference ." 

Frames of reference vary in their structure and in the degree to 
which they are articulated by their users. Some have achieved a high 
degree of self-consciousn<^- -^s and codification and others have not. One 
objective then is to identify and present the components of working frames 
of reference used in social inquiry. (Some first steps in that direction 
have been taken through a working paper and the interview checklists 
presented in the appendix.) 

2. Demonstration of a method for discovering a scholarly frame of 
reference . 

The procedures developed for this study are used for this purpose 
and are subjected to tests of pedagogical and empirical adequacy. 

3. Orientation of students to differently structured frames of reference 
from varying disciplinary contexts .. 

This, in a sense is the grossest objective and here the danger 
exists that it may be misconstrued and misused. It is our intent in 
interviewing any one expert to develop an object "frame of reference" 
which can be compared and contrasted to the other objects presented in 
the other interviews. No attempt will be made to derive the frame of 
reference of one of the participating disciplines af- such", every effort 
must be made to avoid the impression among students that we have 
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"encapsulated" the discipline from which our expert participants come. 
The interviews are to present orientations to special aspects of scholarly 
practice. 

4. Exploration of the dynamics of knowledge production. . 

Through: the rather detailed and close--up review of instances of 
social inquiry a veiry fine grained picture can be presented of the 
dynamics of knowledge production. It is hoped that a contribution can be 
made to such questions as the forming of paradigms in scholarship and of 
epistemic communities supporting them. This objective is broad and 
explorator>' but of importance nevertheless. 

5. Production of instructional materials . 

The interviews and their analyses will become the subject matter 
for instructional materials hopefully to be used in settings similar to 
the multi-disciplinary doctoral program within which this study is con- 
ducted. 
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Arthur Melton, the expert from the discipline of experimental 
psychology whom we have invited to participate in our Frames of Reference 
study, has designated the papers that he wishes us to focus upon in our 
interviews. In addition to these papers, I have included an earlier re- 
view paper entitled "Learning" which was published in 1950 in the Annual 
Review of Psychology and excerpts from two books which Melton edited. 
Categories of Human Learning > 196A and Coding Processes in Human Memory > 
1972. 

I have extended the review of Melton's work beyond the papers 
designated by our visitor for two reasons. First, by doing so it is 
possible to use Melton's own reviews of the field and his- discussions 
of conference papers to acquaint those of us who are relatively unfamiliar 
with the research in this area with the major concerns and shifts in focus 
over time. Secondly, it exposec^^ us, howe-rrer inadequately, to the import- 
ant role that Melton has played in organizing the research of his pro- 
fessional reference group and thereby possibly influencing a systematic 
attention to the controversies that need to be resolved or the gaps in 
knowledge that he feels must be filled for general theory construction. 

In large. measure, I have used Melton's oxm words and therefore 
the entire paper may be considered as a series of quotations, I, how- 
ever, take full responsibility for the selection of these and in doing 
so for distortion or significant omissions. 
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In a paper entitled "Learning" published in the Annual Review 
of PsycholoRv, in 1950, Melton organized a review of the exper'Sien'tal 
literature in order to point out the controversies that existed and 
possible directions that research or theory-development might take to 
lead to a resolution of these controversies. Melton suggested that 

9 

although there were many contempory theories of learning, the attempt 
that Hilgard had made to dichotoinize them into stimulus-response theories 
and "field" theories (Hilgard, Theories of Learning , 1948)provlded a 
feasible framework. Furthermore, mapping the research literature in 
this manner leads to a recognition of the sources or the substance of 
the controversies. 

The types of experiments undertaken by S-R and field theorists 
and the types of problem situations are not noticeably different. Melton 
contends that "the basic difference is the nature of the constructs or 
intervening variables, chiefly the constr^ucfis, which are employed in 
the interpretation of the observed stimulation-organism-behavior 
relationships," 

The field theorists assume that the person through relatively 
autonomous selection and elaborative operations establishes a field 
map of the environment and associates different environmental events 
into cognitions, insights, hypotheses or cognitive mapS, These cog- 
nitive relationships occur through togetherness in time, contiguity, 
plus the organizing property of mind. The comprehensiveness of the 
cognitive map w.:,ll determine whether the learning is utilized in 
general form which favors transfer of learning or in a limited 
"habitual" way which does not favor transfer. Field theorists have 
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a pluralistic theory of learning and consider the type of learning 
studied by S-R theorists to be but one type. 

For S-R theorists, learning always involves the establishment 
of connections between stimulating conditions and responses or acts, 
where the reaction potential is equal to habit strength times the drive 
strength and the effective reaction potential of a response is determined 
by the algebraic summation of the reaction potential and inhibitory in- 
fluences. The effects of learning spread according to principles of 
stimulus generalization, which assert that the habit strength or inhibitory 
strength attached to a particular stimulus will generalize to similar 
stimuli, the amount of generalization being of a function of the degree 
of similiarity. The S-R theorists have attempted to derive all higher 
processes from principles which are necessary and sufficient for pre- 
su^bly simpler forms of learning. 

Having reviewed these dichotomous approaches to a theory of 
learning. Melton suggested various controversies to be resolved: 

(1) Whether reinforcement is not merely influential but a 
necessary condition for learning. The major issue here 
is whether latent learning occurs, that is, lAether the 
organism can learn through processes of perceptual or 
cugnitive organization which depend only on temporal 
contiguity, in the absence of a temporarily contiguous 
reinforcing state of affairs. S-R theorists have argued 
that apparent learning without rel,nforcement can be 
explained on the basis of secondary reinforcement and 
secondary motivation, 

(2) Continuity versus noncontinuity in learning. Does the 
learning process involve a continuous modification of 
S-R relationships or is it properly described as a 
discontinuous sequence of organizing acts? 
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(3) Place Learning versus Response Learning. Is the 
learning process a specific stimulus-response 
relationships (response learning) or a cognitive 
organization or field expectancy (a place or direc- 
tional disposition). 

(4) Transfer of Learning. 

The major concern here is to explain the utilization 
or failure of utilization oi' previous leading under 
conditions which differ in some respects from the 
conditions extant during the original learning. 

(5) Retention and Forgetting. 

The major advances in this area had not at this time 
been ii*corporated into the learning theories of either 
the S-R or field theorists. Some research had indicated 
a need for a preservation or consolidation hypotheses 
in tha interpretation of retention and forgetting; 
other research had focussed in proactive and retroactive 
inhibitions as the dominant factors. 

In 1962, in an address to the Psychology Section of the AAAS, 
Melton discussed developments that had focussed attention on memory. 
Learning theorists had revived their interest in the appropriate 
assumptions to be made about the characteristics of the memory 
traces that are the products of experiences and repetitions of 
experience. Several findings of the last few years had focusstfd 
attention on the interaction of memory traces during learning as 
well as interactions at the time of retrieval or utilization in 
recognition, recall or transfer. An increase in theorising and 
research on Immediate and short-term memory h^d also directed atten- 
tion to the need for a general theory of memory. 

Learning, which may be defined as the modification of behavior 
as a function of experience, operationally deals with the question 
of whether (and, if so, how much) there has been a change in behavior 
from Trial n to Trial n + 1. It must therefore encompass three 
processe^i: trace formation, trace storage and trace utilization- 
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as well as other processes such as those unique to the several 
varieties of selective learning <^nd problem solving. Melton suggests 
that advantages will accrue by considering a general theory of memory 
to be only a portion of a theory of learning. A theory of memory will 
be concerned with the storage and retrieval of the residues of demon- 
strable instances of association formation. A theory of memory will 
be restricted to a concern for post-perceptual traces, i.e., memory 
traces, and not' with pre-perceptual traces, i.e., stimulus traces. 
Although stimuli may affect the sensoritim for a brief time unless 
they get "hooked-up", associated or encoded with central or peri- 
pheral response components, they do not become a part of a memory- 
trace system. 

Given this restriction to storage and retrieval of traces, the 
principal issues In a theory of memory are: 

(1) Should memory traces be given the characteristic of 
autonomous decay over time, or should associations, 
once established, be considered permanent? 

(2) Does the memory trace become enhanced by autonomous 
consolidation through reverberation or preservation? 

Does it require this in order to become a stable structur- 
al memory trace in the central nervous system? 

(3) With respect to the morphology of memory, an isftue has 
been whether an all-or-none notion or an incremental 
notion of association formation (i.e., that the same 
trace system is activated, reactivated and strengthened) 
is most accurate or whether both are true, 

(4) Are there two kinds of memory storage or only one? 

It has been contended by those who hold a dual-mechanism 
view that the Short Term Memory (STM) involves '^activity" 
traces subject to autonomous decay, and has a fixed cap- 
acity whereas Long Term Memory (LTM) involves "structural" 
traces which are irreversible and non-decaying and is 
Infinitely expansible. Those who hold a monistic view 
ascribe the same p roperties of LTM to the characteristics 
pf traces of events that occur only onct. 
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Melton considers this last issue - memory as a dichotomy or 
continuum - significant to the theoretical problems of trace re- 
trieval and utilization. "The conflicting notions with respect to 
the properties of trace storage and the conflicting notions with 
respect to the principal determinants of trace retrieval, or 
failure thereof, converge on the more fundamental issue of the 
unitary or dual nature of the storage mechanism." 

Melton's approach to problem resolution is to examine the 
alleged differences between STM and LTM in light of recent research 
on STM. He reviews the experimental data on STM to see whether they 
are interpretable in terms of the interference factors known to op- 
erate in LTM and whether the durability of memory for sub-span and supra- 
span to-be~remembered units is a continuous function of repetitions. 
The Peterson & Peterson experiment s determined the recallability of 
single trigrams (eg., XBT) at vatfH^intervals from the time of pre- 
sentation. One second after the trigram was presented, a three digit 
number occurred and the subject was asked to count backwards by 3 or 
4*s from that number until they received a cue to recall the trigram. 
The results revealed a rapid deterioration of performance over time. 
This did not resolve the question of whether traces from single 
occurrences are on a continuum with traces from multiple items learned 

✓ ' ^^^^^^^ ; 

through rep^t'ttion. A variation of this experiment was conducted by 
Murdock. Instead of trigrams, Murdock used single common words in one 
experiment and then word triacis (3 unrelated common words as the 
to-be-remembered unit). The results were that single units showed less 
forgetting than did trigrams but that some forgetting occured even with 
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such simple units. 

These data suggested that the number of "chunks" in the to-be 
remembered unit determined the slope of the short-term retention 
function. Melton considered of even more linportance the Implication 
that, other things being equal, the rate of forgetting of a unit 
presented once is a function of the amount of intra-unlt interference 
• and that this intra-unlt interference is a function of the number of 
encoded chunks within the item rather than the number of physical 
elements, such as letters, or Informational units. Melton then 
conducted a number of experiments to determine the retention curves 
based on the number of chunks in the to-be-remembered unit, the number 
of repetitions, and the number of digits that had to be put in between 
repetitions to work out the repetition effect. The results Indicated 
that events which contain chunks beyond the normal memory span can be 
brought to the criterion of perfect immediate recall by reducing the 
number of chunks through repetition and that the structured memory 
trace established by a single occurrance of an event seemed, by the 
number of intervening digits that were required to work out the rep- • 
6titlon effect, to be extraordinarily persistent. Melton suggests that 
a single type of storage mechanism is preferable to a dual-storage 
theory because in such a continuum, frequency' of repetition appears 
to be the important independent variable, -chunking" seems to be the 
important intervening variable and the slope of the retention curve 
is the important dependent variable. 

In 1964, the contributions of participants in a symposium on 
"The Psychology of Human Learning" organized by Melton at the University 
of Michigan were published as a book. Categories of Human Learnin.. 
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It was Melton *s contention that a taxonomy of human performance requires 
a taxonomy of human processes, and vice versa. The categories of 
human learning attended to were restricted to those that had been 
brought tmder controlled laboratory observation and did not include 
perceptual learning, discrimination learning and some forms of 
attitudlnal or emotional learning. 

In his section on the development of a taxonomy. Melton sav*; 
that the noting of the similarities and differences of things and 
events is the first step in organizing knowledge about nature. These 
observations are then the basis for cZassif ication of things and 
events and for the formulation of criteria of inclusion and exclusion. 
A taxonomy reflects both the primitive operational categories and 
the stages of development of a science. There is a need to limit the 
generalization of empirical findings to a category or even a subclass 
of a category, until there is evidence to support a wider generalization. 
Levels of generality, both intra-category and inter-category, must be 
achieved either through systematic empirical investigations which bridge 
boundries within or bet^^een postulated categories or by theories which 
employ hypothetical constructs or intervening variables to reveal the 
presence of similarities and differences that are more fundamental than 
those obtained at the observational level. The theories included in 
the book are still for the most part intra-category theories and as 
such, are frequently very closely tied to a limited set of experimental 
operations xd.thin the category. Primitive categories have been changed 
through the refinement o2 their defining operations and through the 
identification and differentiation of subclasses of the category. 
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Major primitive categories have been absorbed Into others or major 
categories have been split into cwo. Melton predicts that a very 
complex and radical revision of the primitive categories based on 
a deeper understanding of the similarities in the processes involved 
in these various kinds of learning may occur in the near future, as 
our data and theory permit movement from observables to constructs, 
from a variety of special theories tied to specific experimental 
observations to a general theory. 

It is clear that psychologists must expect, and are getting, 
a progressive movement of the taxonomy of human learning processes 
away from a strictly operational base and toward a theoretical base 
in which inferred processes become the categories. The theory-based 
taxotxomy will probably supplement rather than supplant the operational 
taxonomy. The reasons are that the descriptive anchor for the Inferred 
process taxonomy will continue to be the operational taxonomy of 
learning tasks and the operational taxonomy is likely to continue to 
serve as an analytic, descriptive tool of the technology of human 
learning* 

In Learning and Individual Differen ces^ (Gagne, editor) Melton 
states, in his chapter on "Individual Differences and Theoretical 
Process Variables: General Comments on the Conference", that it is 
necessary that we frame our hypotheses about individual differences 
In terms of the process constructs of contemporary theories of learning 
and performance. According to Melton, the most significant development 
in theorectical and experimental psychology has been acceptance of the 
need for theoretical statements about processes or mechanisms that 
intervene between stimuli and responses. The interest in manipulating 
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and finding individual differences in the hypothesized process will refine 
the analysis of the process and contribute to a taxonomy of processes. 

If there are observable individuart. differences in performance 
that can be traced directly to individual differences In a process that 
is identified in a theory, then the theory gains in predictive power 
and acceptability; if the process does not vary between individuals, 
there Is probably something wrong vith the process construct. Melton 
distinguishes between a task taxonomy and a process taxonomy. The 
former has to do with combinations of operationally defined tasjk var- 
iables, the latter with inferred processes within the organism. s-R 
Association and Information Processing are competing theoretical approaches 
to human learning and performance, both of which use a process language 
to describe what is going on within the organism between input stimulus 
and output response. Information Processing theories emphasize 
"mechanisms" or "acts" that process inforiratlon as it enters and passes 
through the nervous system. S-R Association theories seek an explanation 
of the sequencing of these intervening events and the determination of 
the output response in terms of relations between antecedent (stimulus) 
and consequent (response) events chat reflect learning and transfer of 
learning (based on principles that relate transfer to stimulus similarity). 
These are not ii^compatible approaches and a convergence may come about. 

From the research on recall of three-consoaant trigrams, we know 
that the slope of the short-term memory function Is less steep the higher 
the meaningfulness of the trigrams. The difference between high-mean- 
ingful and low-meaningful trigrams can be eliminated by providing the 
subject with a cue for recoding the trlgram into a meaningful unit. 
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Individuals may be trained to generate their own recoding and it seems 
probable that the principal factors in verbal learning may be the avail- 
ability and efficiency of such recoding operations that the subject per- 
forms on the sequence of events that is being experienced • 

In 1967, Melton comments in "Decision Processes in Retrieval 
Prom Memory", (Concepts and the Structure of Memory, Kleinmuntz, ed.) 
that he is impressed by Peterson's notion that overt responses do not 
have a one-to-one correspondence xd^th implicit responses to a stimulus, 
but are rather the outcome of an "editing" process. The individual 
tests Implicit responses and applies a criterion to decide which is the 
"correct" response. Melton considers various types of tasks in which 
this seems to occur and he suggests that "our civilization could never 
have developed if man always automatically said what he thought, never 
reserved judgement and action until alternatives had been examined, 
nor experiences uncertainty about the appropriateness of any overt 
response." Much of the recent research suggests that what were consid- 
ered unitary processes are made up of sub-processes. Peterson's notion 
of a deciding process may be a sub-process. Whether it is consistent 
with the basic tenets of S-R association theory has not been established. 
"Our response to his model should be directed toward its refinement in 
the customary give-an-take that scientists engage in when they 
recognize that an important concept has been identified, but they are 
uncertain about the details of its operation and application." 

Melton goes on to question the deceptive simplicity of Peterson's 
notion by saying that Peterson has not addressed the problems of 
(a) what determines whether the stimuli are distinr*:ively coded or the 
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responses are available in the memory store or (b) how the variations 
in stimulus coding and response availability affect the outcome of the 
decision process. Melton suggests other ways of explaining this process 
which are based on associationist theory. Melton says that his 
bias is. to build complex multidimensional determinations of the implicit 
resi)onse into it3 eliciting antecedents rather than into a monitoring 
of the transmission from the implicit into the overt response. Peterson's 
simple model lias "touched a sensitive neirve in an old associationist." 
Gofer, on the other hand has developed a thesis that stimuli are coded 
and classified at the time of storage in memory rather than at the time 
of retrieval. Melton feels that these notions will focus further research 
and theory on the processes involved in retrieval from memory. 

In his article, "The Situation with Respect to the Spacing of 
Repetitions and Memory" (1970), Melton reviews the papers presented at 
the Midwestern Psychological Association symposium (May, 1969). These 
papers deal with the relative effectiveness of massed practice (MP) 
and distributed practice (DP). Melton suggests that effort had turned 
away from studying the MP-DP issue on learning other than verbal 
learning because refinement of theories required that they use the more 
readily controlled experimentation that was possible in verbal learning. 
Melton believes that the experimental data that has been amassed suggests 
that they are on the verge of understanding why and under what conditions 
repetition improves remembering. In "MeaningfulneiiS and Trigrani R^og- 
nition" (Martin & Melton) a systematic exploration by means of controlled 
laboratory experimentation of the role of M (the level of meaningfulness 
of the verbal unit) in a recognition task is reported. Recognition is 
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found to be directly related to the M level of the trlgrams presented 
and declines as the number of intervening presentations increases. False 
recognition is inversely related to M level and increases with the total 
number of presentations experienced. Martin & Melton point out that the 
conclusion that the M affects correct recognition in the same way that it 
affects recall does not necessarily mean that recall and recognition 
depend on the same underlying processes. 

In his preface to Coding Processes in Human Memory , Melton sug- 
gests that changes have occurred in the field which are symptoms of 

r 

a Kuhnian paradigm shift. Melton asserts that that attempts to reconcile 
the controversies of the decade before 1962 had focussed attention on 
what Was being learned, i.e., stored in memory. A methodological 
4evelopr?.er,*:. occurred which allowed questions to be raised and answered 
about what is stored in memory and about the way what is stored affects 
retrieval. Pretheoretic conceptions were used as its ban for development 
of specific theories. ''The traditional association theory, which dealt 
with associative dispositions between input and output events according 
to a conditioned response analogy, has given way to theories in which 
the learner is conceived to be an active processor of input events 
(stimuli) and selector of output events (responses), with the products 
of learning being conceived as stored perceptual or c^Dgnitive events 
(event traces) and relations between them (associations)." The coding 
concept - coding, encoding, recoding, decoding, functional stimuli, 
chunks, subjective units - is the third symptom of a shift. As the term 
is now being used by psychologists, it has scrong mentalistic overtones. 
However, Melton suggests that there is no necessity that these components 
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of a coding response to a nominal event be conscious or reportable. 
There is no need to depend seriously on introspection. as a method for 
identifying the structural properties of a coding response. The 
experimental methods of the objective psychologists can be employed in 
further research on this construct. In "The Concept of Coding in 
Learning - Memory Theory" Melton claims, "Coding is the core concept 
of what might well be termed a new dynamic structuralism of mental events 
In which the Information processing activities of the learner define the 
structure of stored traces and these in turn define what is retrievable 
and what is retrieved., but again with no constraints based on awareness 
of either the coding process or its product, the code." Melton traces 
the experimental research that led to this construct - the distinction 
between the nominal stimulus and the functional stimulus (the stimulus 
as coded) and the notion of "chunking" in response learning. He reviews 
the contemporary experimental research which is based on the construct* 
He concludes by suggesting, "I am confident that we will have gaiu^d 
substantial new knowledge about learning and memory as a consequence 
of the coding concepts, knowledge and understanding that we would not 
have gained otherwise." 
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Introduce fnn 



a tr.i.,„ to say that th. sociology of toowUdge U conoerned 

..e social conditions aH.oting not only the p.odnction of .no„Udg. 

^ut the vety existence of pledge it,,.lf. (Berg„ and .„o,»an. 1566- 

HOW, l,,3. Hahe^as. 1,73). It is ™oh less a t„is„ to say that la 

Of the cental p.ohle^s of the sociology of pledge is the .ole of the 

various academic and professional disciplines In th 

P-^™^ " 'he construction of kno»- 
ledge .(Churchman, 1,71, Mitroff. l„„. ^^^^^^^ ^^^^^ 

Historical estahlishment and evolution, there is little denying that 
the discipline,: .ave had an enormous effect. „o matter ho„ .uch lip ser- 
-a is currently givan to interdisciplinary and transdisciplinary efforts, 
the fact regains that the disciplines are still the hasic units for the 
production and organisation of knowledge. The influence of the disci- 
PUnes is such that they are not only a prime factor in the production of 

P-sonal attitudes and heliefs of their practitioners (Kitroff . 1,„) 
- the disciplines provide depersonalized, abstract criteria and stan- 
^r.s for the assessment of scholarly and professional „or.. they also 
Ptevide intense standards for personal association, for example, the for- 
mation Of life-long friendships and patterns of collahoration. »o less 
-portent, they provide personel models for the charting and development 
Of careers. Especially the institutionalization of epistemic criteria, 

i-e., of standards of evidence pn^ r.^ .^ 

cience and of proper communication, is structured 

in the disciplines,. 

This is not .0 i.ply ,hat the foregoin. Is necessarily .ad. The 
discipunes have provided and continue to provide necessary and vaXuahXe 
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anchors for the organization of knowledge. However, this is not to say- 
that the picture is all benign either. If, as Russell L. Ackoff (1968) 
has so aptly put it, "Nature is not organized in the' same way that 
universities are./' then the production and organization of knowledge by 
disciplines is by its very nature artificial and arbitrary (Churchman, 
1948, 1953, 1961, 1971). If problems are only abstracted with difficulty 
from a messy (i.e., a highly interactive) world, then it is neither clear 
that problems neatly map into the disciplines nor that the disciplines 
are sufficient to "capture their essence." It is not clear that the 
essence of problems — let alone reality — is captured through a process of 
divide and conquer by autonomous disciplines (Churchman, 1948, 1971). To 
put it somewhat differently, if the disciplines allow us literally to 
"see" certain things that we could not see without them, then it is also the 
case that they equally prevent us from seeing other things. Disciplines 
like men have their blind as well as their sightful sides. If the disci- 
plines promote the capacity for seeing, then, as Thorsten Veblen put it 
with characteristic insight, the disciplines also inculcate "trained 
incapacity," the ability to ignore and not even s^=ie certain phenomena 
or other "realities" (Foss, 1971, 1973). 

This paper constitutes a progress report; of a study that the authors 
have been conducting of various academic and professional "frames of ref- 
erence." The main purpose of the study is to elicit and to study in 
depth the means that representatives from various disciplines use to view 
and to order the social world. While the full report of the study is 
concerned with both the substantive as well as the methodological results, 
the present paper focuses almost entirely on the methodological aspects. 
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The reason is that not only are the substantive results of the study still 
in process, but also and more importantly, there are comparatively few, if 
any, papers on a methodology for doing empirical studies in the sociology 
of knowledge. To be sure the literature is long and full on theoretical 
studies and papers. However, it is short and lean on empirical results and 
especially on methodological insights derived from actual empirical studies. 

The structure of the paper proceeds on two main parts. The first 
part consists of an exposition of the methodology for studying the phenom- 
euom of a frame of reference. Major elements of the methodology were 
evolved on the basis of theoretical work prior to the actual interviews 
with the participants and have remained fixed over the course of the study. 
Other elements evolved and grew out of the study itself. Further, some, but 
not all, of the elements are seen as "necessary" to any empirical inquiry 
in the sociology of knowledge. Others are merely particular to the present 
study. Whether any or all of the elements taken collectively of the present 
methodology are "sufficient" is itself a topic for further inquiry. We 
would merely note at this point that an over-preoccupation with the question 
of sufficiency has been one of the main factors retarding the development of 
the sociology of knowledge. We shall say more about this shortly. Finally, 
the second part of the paper consists of a series of exhibits (appendices), 
i.e., the actual interview schedules that we have developed to explicate 
as well as to study the notion of a "frame of reference." 

A word of qualification is in order before proceeding further. It 
is not the purpose of this paper to review the long history of previous 
writers whose works bears on the sociology of kncwlr^dge and to vhom we 
are deeply indebted. Nor is it the purpose of this paper to offer a 
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complete or a precise definition of what is meant by concept of a frame 
of reference. The authors not only doubt that a "complete" and "precise" 
definition can be given of any concept but that the attempt, to do so prior 
to the conduct of an empirical inquiry may actually be self-defeating. 
This is not to adopt an extreme empiricist position. If prior to the 
conduct of an inquiry one is advised not to spend all of one's time seekxng 
a prefect definition, one is" also advised to have as clear an idea as 
possible as to what one is looking for prior to contact with the "it" one 
is seeking. Otherwise one may not be able to recognize the "it" one is 
studying upon its presentation. 

By the term "frame of reference" the authors mean the underlying 
structure of cognitive assumptions, personal dispositons and symbol systems 
which form the context within which inquiries proceed and knowledge is 
arrived at. These include not only epistemological and methodological 
assumptions, but also schemas (i,e,, categories into which information can 
be at least tentatively ordered and hence received in the first place. It 
also includes an inquirer's preferred modes of explanation and theory, 
including knowledge and reality "tests" by which the inquirer "guarantees" 
(validates) the knowledge that is produced as a result of his or her pre- 
ferred way of inquiring. In short, a frame .of reference may be characterized 
by the following:^ 

(1) the set of primitive intellectual elements or notions out of 
which an inquirer builds an intellectual explanation or model; these 
primitive elements may b; .regarded as an inquirer's basic "givens", i.e,, 
what is regarded as a set of basic, unproble, qtic beginning points; 
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(2) the set of intellectual operators (i.e., methods) by which an 
inquirer transforms the basic elements into a set of outcome propositions, 
i.e., knowledge outcomes; 

(3) the set of ''reality tests" by which an inquirer guarantees or 
validates the basic beginning points as well as the outcomes of his or 
her inquiry process; 

(4) an inquirer' b rognitive and emotioiial map of other disciplines; 
i.e., an inquirer's intel.'iectual and emotional stand towards other dis- 
ciplines; this is only in part a measure of an inquirer's "breadth of 
vision;" 

(5) an inquirer's relationship to other scholars, i.e., one's 
place in an intellectual network including who one's "significant others" 
are; and finally 

(5) an inquirer's self-awarene.ss (self-consciousness) of each of the 
preceding factors including one's self-esteem as a person and as a scholar 
this also includes one's awareness of his or her disciplines' history and 
the degree of articulation of the frame of reference itself. The reader 
is referred at this point to the first two exhibits in Appendices I and II 
which contain two of the three sets of interview questions and situations 
used to elucidate each of the preceding elements of an inquirer's frame 
of reference. 

Some Methodological Considerations 

The methodological issues with which we are concerned can be grouped 
as follows: (1) the issue of self-reflection; (?.) the t-rcinsdisciplinary 
nature (requirement) of a frame for studying ocher frames; (3) the nature 
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of the entry process, i.e., the selection of the participants; (4) the 
conduct of the interviews, i.e., the processing phase of the study; (5) the 
analysis of the interviews? and (6) the re-entry phase of the study, i.e., 
the feedback of results to the interviewees and the public release of the 
study. We discuss each of these issues in turn. 

The Issue of Self-Reflection 

The idea of self-reflection or reflexivity is central to virtually 
all phenomenological theories of knowledge (Habermas, 1973; Hill, 1972; 
Lobkowicz, 1973; MaCarthy, 1973). As such the concept also plays a cen- 
tral role on the sociology of knowledge (Berger and Luckman, 1966; 
Holzner, 1968). The issue is the following: First of all, how critically 
self-conscious must an observer be of himself (i.e., his own inquiry 
process) before he can critically (i.e., accurately and faithfully) rep- 
resent as well as study the consciousness (i.e., inquiry processes) of 
others? Second, under which conditions, if any, can an observer obtain 
this critical self-consciousness; that is, is such self-consciousness 
possible ? If critical self-consciousness is a prerequisite to the sociology 
of knowledge, is the sociology of knowledge thereby possible? 

l^ile not to bel^.ttle the importance of the issues or those whc 
have pursued them it nevertheless seems to the authors that most discus- 
sions have lost sight of the original goal. The purpose of raising such 
issues in the first place was chat empirical inquiry might take place 
in the sociology of knowledge, it was not that reflection would become its 
own goal endlessly feeding back and turning in upon itself. In the opin- 
ion of the authors. If it is the case that the overwhelming majority of 
sociological inquiries are not reflective snough, it Ls also the case that 
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the majority of inquiries in the sociology of knowledge have been too 
reflective. The result in many cases has been kind of paralysis on the 
action side. Strangely enough, the sociology of knowledge, which has 
always been concerned x^ith the relation between theory (or reflection) and 
practice (or praxis), neglected to develop its own action aspect. To put 
it somewhat differently, the sociology of knowledge put all its "action" 
into reflection. 

If action and reflection go hand-in-hand and help to illuminate one 
another, then the purpose of reflection should not be to foster reflection 
for its own sake, but rather for the purpose of making possible a different 
kind of empirical inquiry, i.e., reflective empirical inquiry. In the 
present study, the purpose of reflection is to serve as a constant remin- 
der that in the process of studying the frames of others ^ the authors must 
take special care to study and to record as much as possible their o\'m 
frame, especially as it influences the development of the study itself. 

To repeat: the purpose of critical self -consciousness is not to 
answer all the thorny issues involved in obtaining such consciousness 
"t^rior to inquiry itself but rather to commit the investigators to a 
critical study of their own methodological assumptions . and decisions over 
the course of their own inquiry. Paradoxically enough, traditional stances 
w^orked against themselves. By dwelling on reflection and further, by 
asserting if not implicitly assuming its primacy they thereby prevented 
a certain kind of crit .cal self-study of themselyc^s ^ — that is, empirical 
r^tudy — on theoretical grounds. 
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The Transdlscipllnary Requirement 

It is far from clear that tha conditions that make critical self- 
consciousness, let aione knowledge itself, possible can be explicated 
through the use of any single discipline. This is especially the case 
given the ways that the disciplines are currently constituted. In a 
word, it is not clear that the central problems of the sociology of 
knowledge are solely those of sociology. Indeed, the problems of know- 
ledge are not those of any single discipline taken in isolation. They 
are not even those of all disciplines taken collectively. Instead, 
it can be argued that an appropriate basis for explicating the problems 
of knowledge is nothing less than transdisciplinary , i.e., a theory of 
knowledge that is not the captive of any single discipline but equally 
well'-grounded in all of them. It would seem to be inherently self- 
contradictory to argue that one can engage in a study of multiple frames 
of reference, let alone pretend to achieve understanding of them, through 
the adoption of a frame of reference that is grounded in a single discipline 
i.g., sociology^ The point is that it yould seem that the appropriate 
frame for studying other frames is nothing less than a theory of know- 
ledge that is transdisciplinary in nature. 

It is unfortunately beyond the scope of. this paper to outline a 
transdisciplinary theory of knowledge, let alone the guiding theory this 
paper presupposes. Of necessity the reader nm.^t be referred to prcvlousJy 
published works (Ackoff and Emary, 1972; Churchman, 1948, 1953, 1961, 1971; 
Holzner 1965, 1967, 1972; Mi::roff, 1973, 1974). Clearly, such a theory 
is a specialized one and proceeds within a special frame or reference from 
which knowledge is studied as an object; it is not to be thought of as a 
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grand synthesis of all knowledge. 

The Entry Process 

In order to maximiEe the possibility of observing the phenomenon of 
interest, it was decided to pick a relatively small number of as strongly 
divergent frames of reference as possible for detailed inspection. To 
strengthen further the possiblity of observing differences, it was also 
decided to select strong and articulate representatives or advocates for 
each of the frames. In addition, since we were primarily interested in 
the operation of different frames within the purview of social inquiry, 
it was further d.ecided to confine ourselves to the social sciences broadly 
conceived. The following are the frames and/or orientation that were 
selected for observation: (1) a representatiye^f rom the field of 
cognitive psychology, (2) a mathematically or formally oriented social 
scientist, (3) an educational psychologist, (4) a psychoanalyst, (5) a 
lawyer, (6) a phenomenologically oriented social scientist, (7) a polit- 
ical scientist, and finally if possible, (8) a social systems scientist. 
These obviously nowhere nea^ exhaust the possibilities that could have 
been chosen. 

Specific individuals were chosen on the. basis of the following 
criteria: (1) that they had each achieved some kind of recognition, if 
not eminence, in their field as indicated by their position, visibility, 
prestige, awards, etc.; (2) that they were each an articulate and vocif-- 
erous spokesperson for a partic , ■ ar point of view either within their 
field or within the social sciences taken generally; and (3) finally, 
that they are willing to participate in our study. The later criterion 
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not only required that an individual be willing to spend at least a day- 
and-a-half in Pittsburgh (at our expense) but that they do some "home— 
worV prior to their visit. 

Initial contact with each individual selected to be studied was 
made hy telephone. The general purposes of the study were briefly ex-- 
plained during the initial encounter. Namely, it was explained that we 
were^, engaged in an in--depth stud> of different points of view in social 
science and that we considered the individual an articulate spokesperson 
for a particular point of view. By our call we not only indicated our 
desire to interview the individual but we also explained that the inter- 
view would consist of three main parts. Part 1 probed for general back- 
ground influences and beliefs (see Appendix I), Part II probed for 
general and specific beliefs with reference to a particular scholarly 
and/or professional problem (experience) that had been of importance in 
the individual V-? career (see Appendix II), Finally, Part III consisted 
of the individual's response to a "common object problem," a summary 

2 

position paper on the Coleman-Jencks debate in the field of education. 

It was made explicit that we would send all three parts of the inter- 
view schedules to the individuals for their detailed inspection prior to 
the interview. This was done for two reasons. One, mi wanted the indi- 
viduals to have the opportunity to think about their responses prior to 
the interv^iews themselves. And two, we wanted the individuals to have 
the opportunity to see for themselves what was involved prior to their 
visit, i,e., prior to their final coimiitment or consent to being inter- 
viewed. In short, we wanted to indicate that we had no "hidden agenda" 
in mind , 
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The Process Phase — The Conduct of the Interviews 

As a general rule, the interviews were divided into two distinct 
phases, a private and a public phase. The first phase, which consisted 
of the questions contained in Appendix. I, was conducted in a relatively 
"private" setting consisting of an3rwhere from two to five people. The 
second phase, which consisted of the questions contained in Appendix II. 
plus the interviewee's responses to the Coleman- Jencks controversy was 
conducted as part of an on-going multidisciplinary seminar of twenty 
or so people. This constituted the public phase of the interview process. 

The interviews were divided into a public and a private phase for a 
variety of reasons. For one, the private phase was not only designed to 
provide an environmenu that would, as m\ich as possible, put the inter- 
viewees at ease and hence allow us to raise and explore personal issues, 
but they were also designed to allow for a good amount of give and take 
between the interviewers and interviewee. The model for these sessions 
was consciously borrowed from the 18th century. We are referring to the 
widely knovm and Institutionalized custor.i process of the frequent ex- 
change of letters between scholars. Although private in the sense of 
their being addressed to a particular individual, the letters of the 18th 
century were public in the sense that they addressed thr:;r.selves to issues 
that were of concern to all and were written with the knowledge, often 
conscioT^s as well as deliberate, that they would eventually be made avail- 
able to general public anyway.. Indeed, it is well knox^n that one of the 
best ways to disseminate a mes-sage widely is to initiate it in private to 
a select fex^;. 
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The 13th century model was important and conscious in the develop- 
ment of the study in another sense. From the very beginning the interview 
sessions were conceived of as exchanges between peers , as mutual discussions 
in the broadest possible sense of the term. The underlying model for 
our study was truly that of experts interviewing experts . It was not 
the model of the all-too-typical social science research situation wherein 
a person of supposedly superior knowledge, the expert, interviews a per- 
son of supposedly lesser knowledge, the subject or the interviewee. Tliis 
• point can not be put strongly enouf - . Although the present study had an 
explicit Interview guide and in this sense the authors were the ''experts," 
to the extent that our "subjects" probed us r.nd that we learned from 
them as "experts" in their fields, we were as much the subjects of our 
own study. The point is that whenever sophisticated parties come to- 
gether, both are equally subject and experimenter and ought to be con- 
ceived of as such. It ought to be noted in this regard that if the 
subjects y.repared for our inter^/iews by reviewing our interview ques- 
tions, then the author .^^ also prepared for the interviews by formally re- 
viewing the work or the interviewees. Indeed, position papers were 
formally prepared and were required reading prior to the private inter- 
view sessions. 

If the purpose of the private interview sessions was to draw out 
the general professional beliefs of the interviewees without reference 
to specific problems (Appendix I), then the purpose of the public ses- 
sions was to draw out the attitudes of the interviewees with regard to a 
specific probler^ that had played an important role in their careers 
(Appendix II). Since the specific problems were unique to each individual, 
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a position paper summarizing the Coleman- Jencks controversy was 
prepared and given to each of the interviewees for their reaction. The 
purpose of this part of the public interview was to draw further the 
differences between frames by witnessing how they addressed themselves 
to a common problem. Because of the relevancy of this part of the study 
it was conducted before a multidisciplinary seminar in education. By 
witnessing how scholars from different disciplines handled a common 
problem, the students in the seminar were given the unique opportunity 
of witnessing how different disciplinary (background) assumptions 
affected not only what questions were posed but how they were answered 
as well. 

Exit and Re-entry " The Analysis and Feedback Phase of the Study 

The purpose of this section is not to engage in an extended and 
detailed discussion of the technical methods by which the interview 
material will be analyzed. This is particularly the case since the 
methods for analyzing interview material is well-known* Rather, since 
the analysis phase of the project is still in its inception, our intent : 
to lay out some of the various considerations that present themselves. 

If social scientists rarely sti»dy equal?, then they just as rarely 
present the results of their inquiries to theiv -utjects, and further 
still, study their subjects' resultant responses. Even rarer is the 
involvement of subjects in that phase of the research having to do with 
the analysis of results. The point is that if our subjects are worth 
interviewing in the first place because they are sophisticated experts 
of distinction in their own right, then their reactions to the write-up 
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and analysis of the study :*s woi th collecting in the second place. The 
use of subjects, especii-.lly sophisticated subjects, in the design and 
analysis phases of social research is still a virtually neglected and 
woefully underdeveloped aspect of social science. 

Since the study of diffemt frames of reference is in many respects 
a study of- different disciplinary biases, the authors would be guilty of 
hypocrisy were we to pretend that we do not have our oxm biases. It 
obviously takes a frame to study other frames. Instead of assuming that 
we or our subjects don't have biases (which we obviously do), the ques- 
tion is, how can we use the fact of our having different points of view 
to aid us in the analysis of bur data? One response is instead of sup- 
pressing our biases (which does nothing to eliminate the), we ought to 
hig?ilight them, to make them as clear and as open as possible. Further, 
since the interviews constitute an exceedingly rich source of material 
and as a result can be analyzed from an almost, infinite number of dif- 
ferent poifits of view, there is no reason why the authors themselves have 
to agree on a common interpretation of every piece of the analysis, 
assuming that we could. Indeed, it begins to become clear that not only 
ought the interviews not to be analyzed from a single point of view but 
that the results ought not to be presented in the form of a single 
report. Instead what occurs is that the results ought to be presented in 
the form of various position statements each of which represent the 
analysis of the interview material from a different point of view. That 
is 5 multiple analysis ought to form an essential analysis of any study 
of multiple frames. Finally, the reactions of the interviewees to the 
multiple analyses ought also to form an essential part of the study. 
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Concluding Remarks 

It is especially fitting to end on a note of self --reflection, for 
on since we began on a note of self-reflection, and two we argued that 
self -reflection is central to tTi^f'BiScifdlogy of knowledge. We also hope 
that we have presented enough arguments to show that while the concept of 
self~ref lection is necessary to the sociology of knowledge, it is not 
sufficient by itself. Or rather, we should say we hoped we have demon- 
strated that a particular form of self -reflection is not sufficient, i.e. 
the kind that only dwells upon Itself and turns continually inward. In- 
deed, while everyone of the methodological guides (reflections) we have 
offered derives from the notion of c?elf -reflection, they are directed for 
the purpose of going outward, i.e., for the conduct of emp ire al -inquiry. 
It is high time that the sociology of knolwedge developed its empirical 
side. We hope this paper consfeitvtes a ccrtribution to this effort. 
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FOOTNOTES 



1. The reader is referred to previous works for a more complex 

definition of what we mean by a frame of reference. See Churchms:: 
(1971) and Mitroff (1973) and Mitroff and Sagasti (1973). 



For reasons of space the summary position paper is omitted fr-jm 
the present discussion. 



3. We are grateful to Professor Paul F. Lazai sfeld for his emphasis 

on the pedagogical and intellectual importance of the expert-expert 
interview, and for his collegial support and cooperation. 
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APPENDIX I 



Frame of Referen ce Interview Checklist I; Scholarly Position and Views 

!• Briefly, how would you describe your luethodological stance? 
-Do other people in your field share this stance? 
-What other approaches do people in your field take which you 

consider significant? 
-Why do you prefer the approach you take to these others? 

2. a) What is the significance of the philosophy of science for your 

own work, your field, the social sciences? 

-What are the main positive and negative contributions the 

philosophy of science has made? 
b) What is the significance of the sociology of knowledge for your 

own work, your field, the social sciences? 

-Are there positive or negative contributions the sociology of 
knowledge has to offer? 

3, One often hears about dichotomies, f.ir example between *'hard" and 
*'soft" science, between '^objective" and "subjective" approaches and 
betwe-n ''pure" and "applied" inquiry. I^ich of these dichotomies, 
if any, do you believe to be valid? In what respects? 

-Should the issues these dichotomies characterize be reformulated? 
How? 
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4. What is objectivity iu social science? 



5. I^at do you consider to be important conditions for the possibility 
of valid observations? 

6. How do you see the relationship between theory, obser'/ation, and 
knowledge application in social science? 

7. What general body of work has had the most influence on your own 
thinking? 

-On your career? 

-Any one person's work in particular? 

8. What do you consider to the domain of systematic social inquiry? 
Of social science? 

-Where do you place yourself in this domain? 

-Can you describe that position by a "label**? 
-Where would you place yourself "geographically" (at the 
center, margin, between two components, etc.)? 
-What part of this domain' has had the mo^t influence on your o\m 
work? 

-Would you describe this influence in terms of specific 
people? A conceptual framework? A tradition or school of 
thought? 

-Which other social science comes closest to your owri concerns 
or is of the greatest relevance to you? I^^hich is of the least 
relevance? Q9 



9. Wlio are the "great" social scientists? 

-Aaong the conteinporar'»'es? 
-Among past social scientists? 
-For all time? 

-Are there "unknown" greats, e.g., under-rated figures? 

10. What do you consider as the greatest contribution of the social 
sciences in the 20th century? 

11. What do you consider the most pressing problems facing the social 
sciences today? 

-Which of these do you feel hamper the growth of the social sciences 
most significantly? 

12. When you think back over your o\-m career to d/ite: 

-What experiences sharpened your own problem focus? For example, 
graduate school, postdoctoral work, fellowships, research 
assignments , etc . ? 
-What are the most significant contributions you have made? 
-What were the most significant disappointments in your work? 
-Is there anything ^'not done" which is now irretrievably lost? 
' Why? 

-Iftat are sources of frustration to you? 

-What do you hope to accomplish in the next five years? 
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When you start formulating a px^oblem? 
-Do you star J on theorectical grounds (for example, what theoretical 
structure)? 
•-Or from data you have collected? 
-Or actions you have had to take? 
-Or historical circumstances of significance? 
•-What other factors enter into your prime considerations? 

When and under what circumstances have you in the past considered a 
problem you worked on as solved? 
-Please offer some examples, if any, for solved problems • 
-In what sense were these problems "solved" (empirically, theo- 
retically, through a redefinition of the issue, because of shifts 
in historical significance, shifts in interest, or other factors)? 
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Checklist for Interview II; Problem of Investij^ation and Strategies of 
Solution * 

Note: What iy to be regarded as the ^'problem'" for the purposes of this 
part of the interview is formulated by the expert participant's 
memorandum, his writings, and the staff paper summarizing the work. 
This interview is designea to explore certain aspects of the social 
contexts and history of working on this problem. 

1, Why and under what circumstances did this problem become significant 
to you? 

-What was the first formulation and how did it relate to then 
existing work? 

2, What is the difference between the initial formulation of the problem 
and the way in which you would forTnulate the issue now? 

3, If possible, could you please give an account of the successive 
formulations of this problem? 

-Are there stages in the evolution of your thought about the problem? 
-What considerations were most salient at each stage? 

4, Did the problem remain the "same** throughout the investigation or did 

its nature change? In ^^hat sen^ a? 



5. OTiat alternative approaches were considered in the beginning of your 
investigation and successively tnroughout it? 

-What alternatives were rejected? Why? 
-What alternatives were pursued? t'Thy? 
-What were anticipated solutions? 

-What did you expect to find in different phases of the investigation? 

6. Given the history of this problem, would you identify what you take 
now to have been critical decisions with respect to problem formula- 
tion, anticipated- solution, or strategies of solution? 

-On vjhat grounds were these decisions made? 

-Do you now t^iink that these were correct decisions? 

7. What is "ho significance of this problem and its solution? 

-What vrrtld change as n consequence of this project in sciencc-s 
in culture, or in society? 

8. What evidence supports the proposed solution to the probl -».? 

-What is the relation between successive formulations of the 
problem, anticipated solutions, strategies for solution on the 
one hand and rules of evidence on the other? 

-Did changes in any of the former lead to changes in the latter? 

9. Were there any critical data in this work? What brought a> out the 
definition of particular pieces of e'^^'idence as stratep,ic? 

-What evidence . /vv lead you to change your mind about the 
strategic sign- ..icance of these data? 
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10. Were there any critical decisions in the progress of the prcJ^ct 
What were they? 

11. Could you briefly characterize your own epistemology? 
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FINAL REPORT FRAME OF REFERENCE STUDY, CONCLUSIONS /vND OUTLOOK 

This report is written at the termination of the data gathering for 
the project. The voluminous materials and experiences now available will 
require considerably more time for in-depth analysis before mature pub- 
lications can be expected. We are working on these steps now; for that 
reason the statement of conclusions and outlook at this time must be pre- 
liminary and tentative. However ^ several things can and should be said 
both about tha saciological and instructional yield of the program. 

The project was designed to establish frames of reference of social 
inquirers as objects of investigation. We entered into it with a rather 
abstract definition and understanding, which the experience of the project 
has considerably deepened and modified. As we stated in the working paper 
above (Studying Frames of Reference, p. 5) "by 'frame of reference' we 
mean the structure of assumptions and dispositions which form the context 
within which inquiries proceed and knowledge is arrived at. These assump- 
tions include epistemologies and methodologies, schemes and categories into 
which information can at least tentatively be ordered, often a *'model" of 
the domain to be inquired into, preferred modes of explanation and theory, 
tests of knowledge and anticipations for the, significance of the knowledge 
to be found in theory or use." 

We were quite aware of the complexity hinted at by this conception, 
and elaborated on it in the conceptual paper ("Working Paper: Frames of 
Reference"). "The interpretation of environments into situations (i.e., 
the construction of meanings) is always the activity of a subject estab- 
lishing more or less determinate relations between 'an experience' and 
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and (a) the subject — thus typically constructing the 'experience' as a 
symbolically representable 'object,' (b) other objects and their object 
relation ('orientation') a location within a 'space' of coordinates, in 
the most simple case a physical frame of reference locating observer and 
object in time and space. More complex orientations are embedded in an 
obviously multi-dimensional, socio-cultural context. 

"These contexts are describable in analogy to descriptions of 
space-time locations- In relation to the process of interpretation, how- 
ever, they function as the talcen-for-granted anchor points, establishing 
the frame to which a specific orientation is related or referred which then 
can be interpreted as 'meaningful,' Further, we are here concerned with 
symbolic interpretations, which involve the selection of some symbol system 
as appropriate for the representation of the experience. The structure of 
the preferred synibolism both enables interpretations to be made and con- 
strains their possible variations. The necessary conditions for the process 
of interpretation thus include the experience of a subject; a system of 
taken-for-granted coordinates within which subject-object and object- 
object relations can be located; and the selection of a system of symbolism 
as the taken-for-granted medium of cognitive operations. These conditions, 
together, constitute the 'frame of reference..' One could describe them in 
analogy to Kantian 'a prioris', of course with the understanding that in 
distinction from Kant wide variability of these functional a prioris or 
taken-for-granted contexts of interpretation must be postulated and in- 
vestigated." 

It is important for us to emphasize that the formal understanding of 
frames of reference as outlined above can be maintained after the work we 
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have done. By frame of reference we do mean the structured context of 
cognitive ''referral points", which become the basis in relation to which 
an inquirer is enabled to arrive at interpretations of his experience. 
Specific orientations to a particular problem of inquiry, often needing 
the establisliment of a deliberately chosen set of specific assumptions, 
concepts, methodologies, and theories, occur within the larger framework 
of reference. 

However, our earlier understanding had been too abstract in the sense 
that we urxder-estimated the degree to which frames of reference are anchored 
in biographical, institutional, and cultural structures; it does not 

a* 

appear that they are easily amenable to change. Powerful motivational 
forces, indeed, personal and institutional conceptions of identity are 
involved. As a consequence, for example, it would be unrealistic to con-~ 
sider problem detection and formulation an easily teachable skill. Problems 
for scientific and scholarly investigation, in the case of every one of the 
experts who cooperated with us in our study, emerged in the intersect between 
several different, but always powerful > motivational, institutional and 
cultural forces. 

Further, it is important to point out that problems of investigation 
are also not easily discarded. The choice of a scientific problem thus 
emerges as an existential commitment on the part of the investigator as 
well as a cognitive decision to be justified in methodological and 
theoretical terms. This point may be obvious to the knowledgeable, but 
the failure to understand it may very well be one of the roots of the 
difficulty in teaching the skill of wise choice in problem formulation to 
graduate students. Perceptions of opportunity, of course, play a major role. 
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Yet, they are not perceptions of opportunities for ephemeral rewards but — 
one is tempted to say — opportunities for identity, achievement and 
recogniton in the large sense. 

Robert Glaser, for example, detected a gap between scientific 
knowledge and its application and perceived it as an opportunity for himself. 
"Taking advantage of* such an opportunity, however, requires total com- 
mitment and the investment of enormous personal motivational resources. 
The existential grounding of problem choices is also dramatically 
illustrated by Lipset's statement about his early commitment to a socialist 
youth movement which was ''a minority of a minority,"- the intense internal 
dyiiamics of which induced in him an experience of questioning, which im- 
printed a demonstrable style of searching for politically significant 
deviant cases in his scholarly effort. .One more example might suffice to 
demonstrate the point; Fararo describes experiencing "a problem of con^ 
sistency" in his own skills which led him to seek perfection in the math- 
ematical formulation of problems and theories. There is a considerable 
variety in this matter; but it is a variety in which we believe to be able 
to detect some order. 

The structure of firmly anchored "referral points" within which an 
investigator formulates his specific and deliberate orientations and programs 
of effort can be described as the intersect between biographic, .institution- 
al, symbolic, and object domains. The formation of a professional identity 
through biographic experience, including the forming of personal and 
institutional loyalties and role identification probably is of the greatest 
significance. The question to be raised here is the nature and scope of 
the resource investments made; it seems reasonable to expect that with their 
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variation there will occur a variation In the flexibility or rigidity 
of frames of reference. 

The institutional context in the domain under discussion here 
refers specifically to the organization of science, or scholar£;hip, and ~ 
most specifically — - to the structure of the epistemic communities and 
institutions directly involved in the production of knox^ledge in which the 
scholar participates. In this regard the nature of epistemic criteria, 
by which fact is to be differentiated from non-fact, seem to be o't' the 
greatest significance. Ap:ain, their variation is large between, for example. 
Melton's preference for experimental laboratory demonstrations, Fararo's 
for de(^uctive mathematical truths, or the establishments of facts in the 
public domain as it is being sought by other participants such as Lipset, 
or the erqjeriential grounding of facts in personal morality as in the case 
of Henninger. In every instance, however there is an awareness of insti- 
tutional requirements with regard to ^epistemic judgments. 

If it may be permissible to speak of institutions that give primacy 
to such requirements as "epistemic institutions,** we may ask questions 
about the source of the apparently enormous sanctioning capacity they appear 
to havfe over scholars. In spite of their variability, epistemic requirements 
are perceived as absolute by th^ individual scholar; considerable anxiety 
and often feelings of guilt and inadequacy are concomitants of this 
orientation. There is no doubt in our minds that without exception all 
interviews revealed the operation of astoundingly intense motivational forces 
operating in this domain. Yet, both the epistemic and the motivational 
structures vary for each individual; It appears to us- now questionable 
whether a schematically proceeding sociology of science, informed by a highly 
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generalized philosophy of what science ought to be, can unravel these 
structures. Again, some order and system can be detected which can 
guide the search for the source of the sanctioning capacity epistemic 
institutions exert in scholarship. 

The choice of symbol systems for cognitive operations, which is 
closely correlated to the cognitive style of a scholar, again is a matter 
of significance. The language of investigation and the rhetoric of pre- 
sentations are different aspects of this phenomenon, but they are closely 
interrelated. The language of investigation i?. much constrained by the 
structure of the problem at hand (the fourth domain intersecting in 
reference frames) and by institutionalized requirements. The rhetoric of 
presentation is more oriented towards the audiences which become targets 
for communication, varying from the narrow group of peer specialists to 
larger publics among intellectuals or indeed in the body politic. Surely 
there must be feedback effects from the rhetoric of presentation to the 
language of investigation which our analysis will probe. 

Finally, the choice of a domain of objects to be investigated imposes 
constraints on the investigator, demands for learning and the development 
of skills which are not easily superseded by new choices. In every one of 
our interviews there was a sense of frustration about the recalcitrance of 
objects that do not easily yield to the investigator's wishes, but force him 
to reconsider, pose puzzles some of which may have no solution — resulting 
in a sense of profound modesty, sometimes even failure, in persons who 
otherwise have every reason to pride themselves in accomplishments. 
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In spite of these complexities, it has' become apparent that frames of 
reference can indeed be constructed as objects of investigation. Clearly it 
is not the normal mode for an investigator who is problem-oriented to reflect 
upon his own frame of reference. It requires special occasions, for example, 
those structured by our methodology. Once they are provided, however, 
every participating scholar was able to present his frame — some times 
unwittingly --r so that it appeared as a virtually palpable object. Frames 
of ref erence normally function , in use , as unre flee ted context s for one ' s 
work. Their coherence and articulation are matters of degree; the coherence, 
we think, varying with the degree of coherence in the body of work itself, 
and articulation varying with the requirements for formalization and 
reflectivity. That is, the greater the latter, the greater the former. 

Since giving an account of one^s frame of reference is not a normal, 
routinized and easily performed activity, great care must be taken method- 
ologically in order to avoid certain obvious distortions. Two of these 
obvious distortions come readily to mind: one goes in the direction of the 
stylized ^'textbook*' account a scholar might give of his work in which he 
simply confornis to the rhetoric of presentation customary in his field — 
which for good and sociological- / understandable reasons suppresses many 
significant aspects of problsm formulation, of choices among cognitive 
strategies, and of the intensity of motivational investments. The opposite 
distortion results if the scholar-subject is invited not so much to give a 
descriptive account of what he does in investigating a problem, but thinks 
he is invited to render an explantion of it in terras of some theory for such 
conduct available to him. Many such theories have currency — psychoanalytic 
ones, as well as certain simple sociological ones come readily to mind. 
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It should be obvious that such account gi'/ing also would suppress many 
significant aspects and impose upon the student of frames of reference 
a great burden of differentiating between uh^ e:q)lanations offered by his 
subjects and those he himself constructs. 

In an ultimate sense, this problem has no solution. All accounts of 
frames of reference are constructed in a social space. It is, however, 
possible to exclude obviously known distortions and to specify — as we 
have done — the nature of the setting, and the symbolic and epistemic 
requirements. Our discussions took place in a setting that at once em- 
phasized cordiality and distarxe, and with considerable emphasis directed 
attention to educating a group of scholars (the frame of reference group) 
about the work and the choices at work made by the scholar-subject. This 
type of setting and focus of the discussion clearly de-emphasized the com- 
munication of the purely private — even though many points were presented 
and discussed which would hardly enter into a widely public forum. It 
also de-emphasized giving much time to self-speculation and introspection, 
in that the body of scholarly work, the production of which was explicated, 
was more or less copsistently in the center of attention. This also was 
the case vith regard to the study of social networks and biographical 
development, as all these matters were unraveled froiii the point of view of 
their relation to the body of research the scholar had produced. The pro- 
cedure was supplemented by the analysis of published documents, the results 
of which entered much into our discussions. In fact, two unusual require- 
ments establishing methodological principle were adopted by the frame of 
reference group, in that its understanding of a scholar's work was formally 
checked for its adequacy with the scholar himself; and the ultimate accounts 
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to be given will have to pass a similar test. 

Some of the instructional results and procedures of the frame of 
reference program have already been discussed in the introduction of this 
report. In spite of all difficulties, modem knowledge -producing insti- 
tutions require, multi-disciplinarity, and therefore it is imperative that 
at least a significant portion of graduate students become acquainted 
with the intellectual, organizational, and personal demands of multi-- 
disciplinary settings. Such settings require reflectiveness; that is, an a-- 
wareness of the multiplicity of frames of reference is not only an intellec-- 
tual, but also an organizational necessity. 

We believe that the frame of reference program has contributed in 
some measure to the overall effectiveness of the Multi-disciplinary Graduate 
Program in Educational Research by focussing explicit attention on frames 
of reference, their structure and on procedures for their adequate com-- 
prehension. Its approach recommends itself to us as an instructional 
procedure to avoid the development of both disciplinary "tunnel vision" 
characteristic of the single-minded and narrow specialist, as well as of the 
alternative error ~ superficiality and non-commital tolerance that might 
grant equal validity to any point of view as long as it does not disturb an 
organizational structure. 

Instructional programs focussing on the solving of research problems 
as such, regardless of disciplinary context, have much -to recommend them- 
selves. However, they should be supplemented by an additional explicit 
attention to the structure and organization of professional reference 
frames in terms of which the same problem might appear differently. 
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The instructional device of semi-structured expert-expert inter- 
views with the participation of a seminar for graduate students has proven, 
we think, effective. It has introduced a d^^liberate effort at teaching 
scholarly communication skills which assist in the transfer of concepts 
and methodologies from one frame of reference into another, and which lead 
to an appreciation and understanding of the coherence of a scholarly approach. 
The focus on completed research programs of living scholars to be scru- 
tinized and reviewed in their et . rety has introduced an unusual degree 
of realism into graduate instruction. Case instances of major investigations 
and the orientations and choices underlying them were made available to 
the participating students in a format of a sufficiently personalized 
nature to communicate the seriousness of scholarly endeavor. If anything 
were to be modified, it would be the length of exposure of a visiting 
scholar to the student group; this might more profitably be a period of* a 
full week rather than the two days we had available* 

The conceptual framework of the frame of reference approach also assisted 
the program at large. Certain aspects of the terminology used by the frame 
of reference study group came to be virtually generally used in the program. 
This appears to have been the case because of the practical utility of 
these notions for handling the daily requirem^-nts of interaction in a multi- 
disciplinary setting. Xn this sense the instructional procedures assisted 
in the development of informal norms for inter-disciplinary and multi- 
disciplinary contacts. It is therefore necessary to emphasize that the 
technique of the expert-expert interview appears to have worked especially 
well because it was embedded in a conceptual framework much of which was 
readily understandable to all participants. It is gratifying to note that 
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several groups outside the Multi-disciplinary Graduate Program in 
Educational Research at the University of Pittsburgh have adopted these 
techniques. For example, the first year graduate pro-seminar in the 
sociology department was conducted, in part, using the expert-expert 
interview device. It appears that the inter-relation between intellectual 
concerns and instructional procedures characteristic of this program 
produced an effective opportunity structure for the participating students 
to further their own learning. 
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